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Announcegsent Letter 


Janugry 19» 1984 


B 1000 SYSTEMS 
DATA MANAGEMENT SYSTEM IT COMSILT) FUNCTIONAL DESCRIPTION MANUAL 


With this letter» we are announcing the availiability cf the 
6 1000 Systems Data Panacement Systesm II (OeSII) Functional 
Cescription Manual» form 1152444» dated Marck» 1984. This is 4 


nek gsanual. 


This manuai inctudes an cverview of the DMSII structure types and 
functional descriptions cf the DMSI4 update @nd reorganization» 
aucit and recovery» end cata base security processes. Also» tte 
CMSTI menmory requirerentts DMS/DASDL code descriptionss and OMSII 
cata structure inforsaticn is provided. This operating 
instructions fer the DMS/DECOMPILER» DMSDASDLANALY» OMS/TBEACK> 
CMS/AUDTIITANALYs and (CMS/{BMAP programs are described for use by 


systems progragsmers end @nalystse 


This manual tis retative to the Mark 11.20 System Software Release. 


Ald technical communication concerning this manuat srkouid be 


cirected ta: 
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Eurrcughs Corporatior 

Managers» B 1000 Softsare 

Froduct Assurance arc Support 

6300 HKellister Avenue 

Goleta» California $3117 U.S. American 


Copies of this pulicztior may be oraered from the Publications 


Centers» Cearborns Michigzn U»S- American. 


Faymond J. Renzutto» Manzger 
Cecugentation = West 
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PREFACE 


The information contzinec in this manual is relative to the Mark 


11.0 System Software Retetase. 


The 8 1000 Data Manacemert System [i COMSII) consists of the 


following components: 


1. A CMSII Cata Ard Structure Definition Language CEMS/DASODL ) 


describes a CMSI1I cata base. 


Le An ANSI 68 COBCL» FNSI 74 COBUL> or RPE&II tanguage 
interface providine programmatic access to the data in the 


data base. 


3% The CMSTI access reutines contained within the program 


DMS/VACR that ccntreil storage and retrieval. 


4 « The CMS/FECOVEFDE frogram automaticalty restores the 
integrity of a datz base that may have been corrupted 


through a system feitiure. 


Se The OMS/RECRGANIZE program used in conjunction with the 


CMS/CASCL compiter redescribes portions of the data tase. 


6. Utitity cregragss tc assist in debugging the OMSII system 


anc CMSI1 cata bases. 
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These conponents form the nucleus of the 8 1000 Data Management 
System II. 

RELATED DOCUMENTS 
The fottowing documerts zre referenced in this manuat: 


6 1009 Systems System Software Operation Guides Votume t1-s 


form number 11515987. 
6 1000 Systems CCHIL Reference Manual» form number 1057197. 


6 1000 Systems COBLL74 Reference Manuals» form number 


11086863. 


E 1000 Systems Repert Program Generator CRPGII) Manuat, 


form numter 1152067. 


6 1000 Systems Datz# Management System I1 Inquiry Reference 


Manuadi» form number 1108875. 


6 1009 Systems DMSTI Data and Structure Definition Language 


CDOeS/CASCL) Larguace Manuats» torm number 1152089. 
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SECTION 1 


INTRODUCTION 


The CMS/CASDL compiler t* the programmatic tool used by persons 
usuatly referred to «s Deta Base Administrators (DBA). One 
tunction of the CHA is te describe a data base to the & 1000 Data 
tanagement System II. Tte overalt caesigqn of the data tase is the 


responsibidity of the C@# and inctuces the following: 


1. Uncerstanding the requirements of ati users of the data 
base. 

Ze Analyzing the varitus demands to be mace on the system. 

ae Producing a data description capable of fulfittling the 


needs of the syste. 


The CBA must atso determine uhich applications require maximum 
optisizaticn ir order te provide overattl efficiency. 8Hecause 
CMS/CASCL ations the flexibitity of many atternative sotutions to 
é given problems the DBA is always in a position to monitor anc 
cptimize the uses of the data base». The CHA must be aware of «tl 
factors anc once the system is designeds must be committed to 


tailcring its structures. 
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Typicatlys the DBA produces a data base desiqn by ustng the 
CMS/CASCL compiler cefarit options to creéete the datz tase 
structures. The CHA can then adtow users to test the various 
applications. As experience is gained and the performéence of the 
system is evaluated» the DBA can experiment with alternative 
solutions. The end results there fores reflects the decisions cf 
the CBA in deterwinirg what is needed to produce the optisum 
usege of the data base fer the entire organization rather than 


for ény one application. 


The types of decisiors tte DBA makes are based on evatuation of 
the critical resources. For examples» at the cost of increasine 
semory usec during progr@gm execution and increasing secondary 
stcrage spaces the DEA mzy decide that some cata should be stored 
in more than one tocetior so ati reiated information can be 
retrievec with one accest. The OBA may atso decide that the 
sequencirg requiremerts cf one application are used a6: eeeels 
thet an additicnad set te maintain that ordering is not 


worthwhite. 


The CBA aiso evatuates tte system requirements in terms of the 
structures and their phyticat parameters» depending on the neecs 
cf the installation» Initiatly» most questions relating to the 
chysitcai parameters cf tte data base are tess important than the 
fogical structures required by the application programs. This 


requirement makes the task of the DbA twofold: 
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1. Selecting structures based on their capabitities for 


supperting the tlogical requirements of the applications. 


Zs Cotigizing the performance of the structures selected. 
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SECTION 2 


CMSIZ STRUCTUKE TYPES 


A cata base is constructed by a DMSvDASDL compitation. The 
contents of the data bast are ustatlay the responsibility of the 
fata Base Adginistrator (DBA). The DMS/DASDL compiler» using 
cescription cf the dzta tase CDMS/DASDL source staternents)» 
frceduces a data base dictionary fite containing informetion about 


each structure described within the data base. 


Cata base structures are either disyoint or embedded» A disjoint 
structure is free standirg.- <A structure is considered embedded 
when it ts declared 2s ar item within some other structure. A 


structure can be one of three types data set» set» or subset. 


CATA SET STRUCTURES 


A cata set ts similar to a conventionat file in that it contains 
the aetuat recorcs of information- However» it is different from 
2 conventicnat file in ttat items within the record can 
themselves be structures» in which case these items are 
considered as embedded structures. A record of a data set which 
cortzgins an embecdec strticture is referred to as the owner record 
of the emtedcec structure. If the embedded structure is a data 
set» a reccra cf the embedded data set is considered a detail 
record of the cwner.e The OBA defines a data set» the items that 


form data set records anc their attributes» zs well as the 
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physical organization of these records. The application 
programmer must be asare of these record items and attributes 
prior to accesSsirg a datz basee Knowledge of the physicat 
crganization of the cata base is not required in order to access 


the cata base. 


SET AND SUBSET STRECTUFES 


Sets and subsets are structures for optimizing access to the 
records of a data set bated on the values of particular data 
items» known as keyse They can atso be used to organize the 
records of a data set into some logical sequence based or the 
values in the key items». A set provides access to ait of the 
records of a data set.»~ # subset provides access to a timited 
codlection of records of the data sete Since severat sets or 
sutsets can exist for the same data set» the same cata can be 
eccessed ir severai cifferent sequences. For examples» given a 
cata set containing empicyee records» one set could order the 
cata in ascending secuence by the dast name and another set coclid 
crcer the cata in descercing sequence by employee number. Those 
cata items of a cata recerd that are used to controt the ordering 


of a set or subset are krown as the key cf the set or subset. 


There are two methods of accessing a data set through a set or 
subset. The first methoc» accessing of records based on tke 
vatue of key fieids» is catted the random access method. An 


exsapte of the rancos access syntax 1s: 
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FIND UAE WV"COURSES vIF UNIV-C=SE] AT CRS“NO = 1234 
The second methoce accessing of records sequentiaily based on the 
value cf the key fields» is the seriat access method. An example 


of the seriad access syntax is: 


FIND UNEW“COURSES VIF NEXT UNIV-C-SET 
fecords can atso be ~ccessed based on the physicat ordering of 
the records within the dzta set. The physicad ordering may or 
way not correspord te the order in which the records were 
created. An example of eccess basea on the physicat ordering of 


a cata set is: 
FIND NEXT UNIV"“CCURSES 
Automatic Sets 


Alt sets are automatic ir that as new records are stored» the 
system automaticattly creztes entries in the set for those new 
records cf the data sete Deteting records from a data set also 
autormaticatly removes the entry from the set. Sets can be either 


embecded or disjcint stracturese 
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Automatic Subsets 


Subsets can be manual or automatic» Automatic subsets specify a 
condition for membership in the subsets the condition is checked 
each time a record is to be added to the data set. If the 
cordition is met» the syttem automaticatty creates an entry in 
the subset. Those data records that meet the condition can te 
accessed by the autosatic subset. Leieting a record from the 
cata set removes the entry from the automatic subset if the 
subset entry exists» Curing an update» the condition is checked 
anc the subset entry car be created or deleted. Automatic 


subsets can be disjoint ttructures onty. 


Kanust Subsets 


A manual subset requires the application procram to insert the 
record in the wanual subset after creating and storing a recorc 
in a data set~ [This requirement establishes an entry in the 
manuct subset for the record in the data set.~ When deleting a 
record» it is necesszry for the apptication program to remove the 
entry from the manuat sutset prior to deleting the record from 


the cata set. Manual sutsets can be embedded structures oanty. 
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STRUCTURE TYPES 


Some exagptes of the strtcture types that torm a data base are 


ifltustratec in the fcottosing text: 


Cata Set with No Sets 


A cata set with no sets wight be itiustrated using a payroltl 
epplicatione in whick every record in the cata set is accessed 


curing the processing of the payrolda program. 


Cocing Exaarple: 


PAYRCLL DATA SEY 
Ce 
e(cata set items) 


YeKAXRECCRES = 10003 
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Physical Structure: 
Fecord Access? 
1. New records are strred in the first avesitable location. 


rae The records car be accessed bused on the physical ordering 


of the data set. for exampies 


FIND FIRST PAYFOLL»> FIND NEXT PAYROLL... 


Me Records cannot be #gccessed based on data vatuese 


Cata Set with Grderec CIrdex Sequentiai) Set 


A cata set with an ordered set coula be used for an employee file 
with the last rame as the keys» The entire data set couid be 
eccessed through the set in atphabeticat order by using the tast 
mame as the key» or eny individuad record could be accessed fy 


using the tast nawe cf the individual as the key. 
Cocing Exaapie: 


EMPLOYEE CATA SET 
CLAST-“NAME Wee 


JoMAXBFECORES = 10€0>5 
L-NAME SET OF EMPLOYEE KEY CLAST<“NAME )» INDEX SEQUENTIAL? 


Fhystcal Structure? 
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Fecord Access: 


1. Records can be accessed based on the physicat ordering of 


the cata sete For exagrple: 
FIND NEXT EMPLIVYEE 


Ze Records can be accessed based on the ordering sequence of 


the set. For examrtie: 
FINC EMPLOYEE VTA NEXT L-NAME 


3. Records can be accessed based on the data value cf a key. 


For example: 
FINC EMPLOYEE VTA L-“NAME AZT LAST“NAME = “JONES” 
Cata Set with Eabedded Data Set (No Sets) 


A cata set with an ernbedced data set coutd be used for an 


employee file in which ar embedded data set was used te account 


tor each of the empicyee'"s dependents. 
Cocing Exarple: 


EMPLOYEE CATA SET 
C. 


DEPENDENT UNGFDERECD DATA SET 
C. 


YeMAXRECORES = 13 
YoMAXRECERES = 100C3 
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Physicai Structure: 


Fecord Access? 


1. Records of data set DEPENDENT can be accessec tasecd on the 


physicat ordering cf the embeaded data set. For example: 


FINO NEXT CEPENDENT 
Ze There must be a valid EMPLOYEE current record in order to 


access a DEPENTENT record. 


Cata Set with Grderec Eatedded Data Set 


This data structure coufc be used with the employee file as the 
cata set and the empfoyee job history as the embedded data set 


ecrcered by the job pecsition. 
Cocing Exaapte: 


EMPLCYEE CATA SET 
{. 


JCHHISTOPRY CRDERFD DATA SET 
CPCSITION ALFHA (20) 


YePAKRECCROS = 10; 
JOB“FOSIVTICN ACCESS TO JOK"“HISTORY KEY CPOSITICN) 
JoMANRECCROES = 1005 
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Physicat Structure: 


Fecord Access: 


i. Records cf datz set JOB“HISTORY can be accessec based on 


the ordering sequerce of JOB-tO5STTICN.~ For exemple: 


FIND JOB“HISTORY VIA NEXT sOB “POSITION 
Ze Records of date set JOB“HISTORKY can he accessed based on 


the cata vatues of the keys» For example: 


FINEC JOBTHISTGRY VIA JOB“PUSITIGN AT POSITION = SYSTEPS@“ANALYST 
36 There must be ~ valid EMPLOYEE current record to access any 


JQE-FISTCRY record. 
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Cata Set with Index Fandems Set and Automatic Subset 


A cata set with a retrievadi set coudd be used with an empioyee 
file so that given a title and departnent» the recore for the 
employee who hoetds ttat rosition could be accessed. An égutomatic 


subset provices access te ati the records of exempt employees. 
Cocing Exagrpie: 


EMPLCYEE CATA SET 

CTITILE 2a 

CEPARTPENT.0% 

EXEMPT-“STATUS 

NAME 

Y»sMAXRECCROS = 1002 

FOSTYICN SET OF EMPLCYEE KEYCTIILE»DEPAR TMENT) 
CUPLICATESs» INDEX RANDOMs 

EXEMPT SUBSET OF EMPLOYEE WHERE CEXEMPIT<-STATUS = 1) 
KEY IS CNAME)» TUPLICATE S> 


Fhystcal Structure: 


Record Access: 


1. Records can be acctssed based on the physical ordering of 


the cata sete For examptes 
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FING NEXT EXPLOYEE 
ae Records can be accessed based on the vatue of @ retrieval 
key» For example: 
FIND EMFLOYEE VIA POSITION AT TITLE = SECRETARY 
ANC CEPAFTMERT = SYSTEMS“PROGRAMPING 
3. Records that satisfy the automatic subset condition can Le 
accessed based on the physicaa ordering of the automatic 


subset. 
Example: 


FIND EMPLOYEE VIA NEXT EXEMPT 
4s Records that séetisfy the automatic subset condition can Le 
accessed based on the value of the subset key.» For 


examples 
FINC EMPLOYEE VIA EXEMPT AT NAME = "JOE DCE" 
Cata Set with Mudtipte Ordered Sets and One Retrievai Set 


This data set could be ar employee tile ordered by both name and 


employee rumber and retrieved by title ang department. 
Cocing Exenrpie: 


EMFLOYEE CATA SET 
CFIFSTNAME.s 
LASTNAME wa 
EMFLOYEE-NO 20 
TIILE «2+ 
CEFARTMERT. 2» 


YeMAXRECCKHCS = 10005 
RAPE SET OF EMPLOYEE KEY CLASTNAMEoFIRSTINAME)» INDEX SEQUENTIALS 
EWP-NO SET OF EMPLOYEE KEY CEMPLOYEE“NO)» INDEX SEQUENTIALSs 
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FOSITICN SET OF EMFLOYFE KEY CTITLE»DEPARTMENT) 
DUPLICATES» INCEX FANDOMs 


Fhysicat Structure: 


Fecord Access: 


1. Records can be accessed tased on the physical ordering of 


the cata set. For exaagntie: 


FING NEXT EwPLOYEE 


C~« Records can be accessed based on any ordering sequence. 
Exampies: 


FIND EMPLOYEE VIA NEXT EMP-NO 
The crdere however» 1s based on the values within the 


records» net the ptysicat order of the records. 


La Records can be accessed based on data vatues of the order 


keye For exameles 


FINO EMPLOYEE vVJA NAME AT LASTNAME = “SMITH™ AND 
FIRSTAAME = "JCEN" 
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he Records can be accessed based on data vatue of a retrieyel 
key»e For examples 
FINC EMPLOYEE VIA POSITION AT TITLE = MANAGER 
AND CLEPARTMENT = FINANCE 
Tuc Data Sets» One Referenced by a Manuat Subset of the Other (No 


Key) 


This data structure coude represent the retationship between 
cepartments anc employeets with each department having a manual 


subset referencing all tte employees of thet department. 
Cocing Exanpte: 


DEPARTMENT CATA SET 


DEPIMEMFLCYEES SUESET OF EMPLOYEES 


JeMANXRECCROS = 103 
EMPLCVYEES DAYA SET 
C. 


YoMAXRECORES = 100C> 


Physical Structures 
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Fecord Access: 


1s Records cf date set EMPLOYEES can be accessed tased on the 


physical ordering cf a subset for a data set. For Exampte: 


FINC EMPLOYEES AIA NEXT DEFT~EMPLOYEES 
ran Records cf data set EMPLOYEES can be accessed ty the 


physical ordering cf the data sete For examrele: 
FING NEXT EWPLOVEES 
Two Gata Sets» Each feferenced by a Subset of the Other 


The prececing example cotld be expanded to order the eaployees 
within a departewent by tteir tast name. Also» there could be z 
manual subset within eact record cf data set EMPLOYEES 


referencing the departwert tn which the emsrpicyee works. 
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Cocing Exarople: 


DEPARTMENT DATA SET 
{. 


CEPT*EMFLCOYEES SUESET OF EMPLOYEES KEY CLASTNAME) 
Jeo MAXRECCROES = 103 

EMPLOYEES DATA SET 
CLASTNAME oe 


EMRP“DEPT SUBSET OF DEPARTMENI 
YoMAXRECCROS = 1003 


Fhysicat Structure: 


Record Access: 


le The records of datz set EMPLOYEES can te accessed tased on 
the chysicat ordering cf a subset of a data set. For 


example: 


FINC EMPLOYEES VIA NEXT DEPT“EMPLOYEES 
Ze The records of datz set EMPLOYEES can be accessed tased on 
the data vaiue of z#n ordered key of the subset. For 


examctles 
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FIND EMFLGYEES VIA CEPT“EMFLOYEES AT LASTAAME = “JONES" 
ae Records cf data set DEPARTMENT can be accessed based on the 


physicat ordering cf the data sete For example: 


FING FIRST CEPAFTMENT 
4. A waster data set wust have a currert record to égccess its 


sutset. 
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SECTION 3 
LPOATE AND REORGANIZATION 


The update and reorganizztion processes changes the physicat 
encd/Jor fdogical descripticn of an existing cata base with the 
maximum system assistance in the actual restructuring of the déta 
kase and the minimum impect on the appticaticn progrems that 


é@éccess the data base. 


UPDATE PROCESS 


The update capability of DMS/DASDL redescribes an existing data 
tase» and toth the dicticnary and the structure files are chanced 
to reflect this new cescription. The chances are egtways effected 
ty running the DMS/RECRGANIZE program following a DMS/DASDL 
upcate C2 UPLATE option) compilation of the data base» and never 


ty the OMS/DASCL compiler itself. 


To use the update capabilities of the DMS/DASDL compiters the 
programmer compiles 42 detcription of the new data tase. This 
cescription is prececec ty a UPDATE statenent which indicates to 
the CMS/CASOL compiler ttat this is an existing cata base. 
Specific reorganization commands controtting garbage cotlection 
enc file altocation can ztso be inciuded in the update rune A 
reorganization contrcit fite is produced by the update run which 
is used by the DMS/REQRGINIZE program in creating the revised 


cata basee 
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There is onty cne recrgarize programs and it is named 
CMS/FEGORGANIZE. Adit infermaticn necessary to perfors the 
reorganization is cortaired in the controit fite . The 
CMS/REORGANIZE progrizm it then executed and the name of the data 


base is entered by means of an accept messzge. 


Reorganization Process 


The reorganization process consists of two stepss an update 
compiles followea by a rin of the DMS/REGRGANIZE progrem. The 
cata base cescriptior is read ty the DMS/DASCOL compiter. A 
comparison is made between the old aescription and the new and a 
reorganization centrcl file is built to affect the changese The 
general syntax of the CMS/DASDL input to perform an update 
compile is; 

SUPDATE 

<aitered data base description> 

FEQRGAATZES 

<reorganize commends? 
The FEGRGANIZE staterent signals the beginning of the reorganize 
cperéstion to the CMS/DASTL compiter.e. There are two kasic 
furctions which can te requested in the reorganize operaticns 
CENEFATE and PURGE, Tre COPY and INTERNAL FILES are used to 
cortrot the aidocaticn of temporary files during the 
recrganizaticn process ard can appear in ttis section. The 


generat syntax of the RECRGANIZE statement is: 
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alla lealeatahelala batt tatataletetatatatatetatatabetatatetateteteteel | 


RECKGAR TZES eo So ees eee ewes Seer eee esas eee Sees Bens Se ma mmm | 
i generate statement> pees, 
ieee <purge statement> soeeeseas, 
pause “copy statement esses 
rigs <internada files statement> _ 
If the data base description has not changed and onty the 
generate and/or purge furctions are needed» it is not necessary 
to incluce the S$UPDATE statement ana the datz tase description. 
In this case» onty the RFIORGANIZE statements» beginning with the 
RECRGANIZEs keysymtcl if used as input to the DMS/DASDL 


compiler. 


GCEAERATE Staterent 


Curing the noreat upcatirg of a data base» the efficiency of tte 
cata base may cetericrste both in terms of the amount of I/0 
required tc access pzrts of the cata base and the amcunt of 
wasted disk spsce» The CENERATE statement can be used to rebuild 
structures to increase tteir efficiency anc make excess cisk 
space avaidabte. Althouch ait structures return unused disk 
space to their availzbie storage tist» there is no meéecharism for 
returning unused fide areas to the system. JUhus» if a structure 
at one time included a very targe number of records and 
subsequently returnec to a more typacal size» none of its unused 
physicat areas are returred to the system. A GENERATE oper ation 
cn this structtre conpresses the structure and returns unused 


file areas to the system. 
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A GENERATE operation on <~ structures» besides garbage coltectine 
unused spaces» causes the structure to be rebuitts» thereby 
restcring it tc a more etficient state. The specific effect is 


cependent cn the stricture type. 


syntax: 
GENERATE c-7 <disjoirt data set> - sce tester e--= Annem 5 = | 
4 i 4 
i i- CROERED BY <tindex set? <-1 
i 1 
i- <emtecded structure> Teste set cess ee eee en eee a=] 
1 i 
A= <incex sequentiat set> “9s <98es4 ese -s 20" e<—=4 
1 j 


J- USING <same set> -! 


Semantics: 


<disjoint data set> 
The <disjoeint data set> field specifies that the GENERATE 
operation causes the records to be read from the old data 
base anc stcered in the newe fhe order in which the recorcs 
are placec in the new data base is guaranteed onty if the 
QRODERED BY keywords are specified. The <index set> field 
specifies the neme cf the set that spans 
<disjaint data cata> and the index cannot itself ke 
logically changed C4for examples» key or ordering change) in 


the same reorganization. 
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<index sequential set> 
The <index sequentizt set> fietd specifies the narze af an 
index sequential set and causes the set to be rebuidtt eitter 
frog the object date set (no USING option) or from the 
existing fine tebtlest (the USING optiond. A generéete 
operation on an index sequential set with the USING option 
1s quicker and causes the set to be tGalanced with 
SPLITFACTGR entries per table. Howevers existing integrity 
errors (for exanple» entries out of order) cata mismatch» 
dead cbhject reccrc» are carriea over to the new data tase. 
Generating the inde? without the USING option causes the 
index te be rebriit by reading the object data set and the 


above mentionec integrity errors to te corrected. 


<eebedced structure> 
The <embecded structure> tfield specifies the nare of an 
embedded structures for examples an embedced data set» anc 
causes the records telonging to each parent record in the 


oid data tase te te found and stored into contiguous tables. 


A generate operatior on an embedded structure causes a 
generate of the parent structure to be performed if the 
parert structure is ailsc an embedded data set. If the 
parent structure is a disjoint data sete it is recreated? 
that is» att recorc: Cinctucing dead snes) are storec at 
their current legicel address in the new file. This 
operation dees not cause addresses in sets or ménual subsets 


of the cisjoint date set parent to need fixing up. 
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PURGE Statesgent 


The FURGE statement removes ait records from a data set or breaks 
ati retaticnshios thet hzve teen estabtished for a manual subset. 
when the PLRGE statesent is specified and the reorganization 
process 3s cemptetes» the purged structure still exists in the 
cata base with the same etructure number and version stamp it had 
tefore the reorganizéetior. Hoxrnevers» there are now no entries in 
the structure. The purge cperation takes precedence over alt 
cther reorganize functiors. PURGE <index set name> causes a 


generate operation. 


Syntax: 


FURGE eset ntnnen Mdata sermon ttt tntr cette ctr nF meee eenenee] 


i j 
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Semantics? 


The «data set> and <Marual subset> fields specify the names of 


the structures to te purced. 


Fragmatics: 


A PUFGE operation on a structure causes its file to be 
reinitiadizec and alt data to be removed from ite When an 
emtecded structure is purged and its parent is not purgeds the 
structure head of the emtedded structure is set to nuit in the 


parent data record. 


A FUFGE cperation of a dézta set causes an tmplicit purge of att 
its embecced structures end at@ index sets and manual sutsets 


which reference tte 


COFY Stateszent 


The COPY cogngand controls: file altocation during the 
recrganizaticn process. By defaults the structures created ty 
the CMS/REGRGANIZE progrem as a result of store operations into 
the temporary new data bese reside on the same pack as the final 
structure in the new dat2 base» The COPY stetement chéenges this 
cefault. whith the CCPY statement» temporary files can be buitt 
cn any pack or tape~»~ At the end of the reorgqanizaticn process, 
the temporary file is coried» with the appropriate nzme changes 


to its perwanent pack. 
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Syntax: 


COPY 2999 ALL went t ete nn ne nn rene TQ serene ence ree nen ee een n> 


i i i 4 


yo wee TAPE ane ORAS TMNT SSS eT COE CH On ee | 


f-- FIN@L MEDIUS cece en oe oe ec ewew ec era nae secre s core anacsean | 
i | 
P= FAMILYNAME = ere DISK werent wen cee ee eres ee esece sees asae | 
q ] { 1 
Y-- <famityname> -~1 f-- » COPY BACK -<-] 

[ee<== <pack: id> “+4 


Serantics: 


FINAL MECIUM 
The FINAL MEDIUPF keywords are the defauit for alt generated 
anc recreated structures and cause ali temporary files to be 


buiit on the pack where the final» permanent file resides. 


FAPTL YNAWME 
The FAMILYNAME keywerd causes the DMS/REORGANIZE prograa to 
buitc the temporary file on the pack named <familyname>. 
The CISK keyworcs dtnotes the system pack. The files buitt 
on the texpcrary pack are copied to the finat media onty at 


the end of the entire reorganization procedure. 
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COFY BACK 
The CCPY EACK keywords cause the temporary files tuiit on 
the specified peck to be copiea back to the final medium 
{destroying the otd copy of the structure) at the end of the 
reorganize procedure for each cluster» This altows the 
reuse of the teaporzry pack for another ctuster* however» 
it a@akes processing after a logical faiture more cifficulit» 
Since the origiral cata tase files were destroyed and needa 
to be reloaded tefore the logicat error can be resotved 
{either by redefinirg tke reorganization or fixing the 
data). For this regsons it 15 recommenceo that this opticn 
only be used when atsotutetyh necessary due to seyere space 


limitation. 


TAFE 
The TAPE tkeyworc catses the input structures to be read with 
the CeSII access rottines and written to tape in a special 
format. The structures are then deleted from disk» reaa 
back from tape end then stored on the final medium. This is 
done cn a ctuster besis so the tape need onty be targe 
enough to held the largest cluster. the tape is then reused 
for each succeecing cluster. the TAPE keyword is intencec 
for systenrs that co not have enough disk space for two 
copies cf their lLarcest structure. If the TAPE option is 
specified for a datz set» it is implied for any embedced 
structures that are generated. The TAPE option 15 not 
implied for a péerent which neeas to te generated «es the 


result of generetine an embedded structure. The TAPE option 
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? 


cannot be specitied for an index which is used in an CRDEFED 


BY statement in the generation of its data set. 


ALL 
The ALL keyworc cautes any required temporary files needec 
during recerganizaticn to be created on the specified medium. 
If the data base hat a structure named ALL» onty that 


structure is aftected by the CUPY statement. 


Pragmatics: 


A warning is inclucec in the CMS/DASDL Listing when the COPY 
option is specified cn a structure which its not being generatec 
cr recreated. <A warring is also inctuded when the TAPE option is 
implied for an embedced ttructure. Address fixup onty occurs 
when the object cf a maneai subset is generatede These fixups 


gre aone inplace and require no additionat disk space. 


INTERNAL FILES Stateagent 


The INTERNAL FILES stateaent controis disk file altocation for 
the XREF cross “reference file used when the object of 2 manual 
sutset is generatede Ey defautt» the XREF file coes to the 


system disk (DISK). 
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Syntaxs 


INTERNAL FILES = CFASILYNAME = wrmrnm= DISK cert stere ip See ee > j 
1 | 
l-- <fasilyname< -71 


CMS/FEORGANIZE Progrza 


After a successful DeS/D#SBL compile using the B8UPDATE options 
whether the FECRGANIZE statement was used or nots the 
CMEVREOQRGANIZE progréem must be run to effect the specified 


changese The syntax for executing the OMS/REORGANTIZE program is: 


EXECUTE CMS/REGRCANTZEs ax <datea base name> ~-~--~-= ie tne a ee 


> ne a ee a oe Se Seaeegw nm ea es m= mw €swnitch settings> See ee en ee ewe eee 
i { 
I-- GN <famttlynane> --1 


The entire data base shottd be backed up both tefore and after 
the CMS/REGREANIZE progréem ts executed. The ON <famitlyname> 
cption is cnty necessary if the data base cictionary resides or a 
user pack. The <sSwitch tettings> are optionad. Alt switches 
cefauit to a vatue ot zeroe Tabte s7"1 give the possible values 


énce meanings for the various switches: 
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Tabie 3-1. OS/REORGANIZE Program Switch Settings 


Switch Value 
1 0 
1 
2 
2 0 
1 
3 1 
2 
4 0 
1 
5 0 
1 
2 
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Description 


Perform the reorganizaticn. 
Perform tabie analysis onty. 


Perform comptete table analysis only. 
Tne compiete table anatysis inctudes 
hex output of the table entries» and 
includes table entries that égppear to 
be irrelevant. Primarity usec in 
debugging probiems. 


Inctude the table enetysis in the 
fisting. 


Exciude the table anatysis from the 
listing. 


Print data before and after 
transformations. Alsc prints more 
Status information. This cén produce 
a very tarce Listing. Used to track 
data transformation errors. 


Print the same output as when SW3 = I» 
and print cetait on the tape creation 
phase if COPY 70 TAPE is usec. Used to 
track data transformation errors. 


Print status messages in the line 
printer fite only. 


Display att status messages at the OCT 
in addition to writing to the dine 
printer. 


Stop at first OMSIL togicat error 
(for examopter dupticates). 


Continue beyond tirst togicai error» 
printing a message for each» but do 
not crezte a usable data base. 


Continue past att errors and create a 
usable data base. The final cata base 
1S missing the records which 

caused the probtems and can have the 
integrity error or write errcr flag 
set on some structurese Any missing 
records 4are printec in hex or the 
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dine printer tisting. 


6 1 Use the one data bese mode. This means 
ondy one data base is cpened at a 
time. Ait intermediate files are 
built on disk before opening the new 
data base files (Cas though TAPE was 
specifiea for alt structures and the 
tape was file equated to disk). 


7 0 Tne DMS/REGRGANTZE program performs 
adt file copies. 


1 Any files having onty thetr name or 
pack changed are not changed by the 
DMS/REQRGANIZE program 


2 Any fites which are to be deletec 
atter the reorganize are not 
deleted ty the DMS/REORGANIZE prograg. 


3 The DMS/REQRGANIZE progrém dees not 
perform titrary file nawe chénges. 
8 0 Printea output is tin dower case. 
1 Printed cutput is in upper céses 
9 1 Enable pause function. A pause causes 


DMS/REORGANIZE to stop and weit for 
user input» typically to take a 
prograr dqusep. There is one pereanent 
pause at the beginning of the 
reorganize programs after the tables 
have been toaded but before the cata 
base 15 opened. At this pauser the 
user can request his date base be 
restorec to its pretreorganize state. 
This is done by enterina <jot #> AX 
RESTORE. This is useful when a 
previous cun of DMS/FECRGANIZE aborted 
wath 2a restartable error and the user 
wishes to return to his otd cata base. 
DMS/REORGANTIZE couid be re~executed 
With Sk9 = 1 and RESTORE could be 
entereo at the first pause. 
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Khen using skitch 9 to erable the pause functions the operator 
gust remember that the RFSTORE operation is conty valid at the 
first pause of the DCeS/REORGANIZE programe The onty other reason 
for enabling the pause ftnction is to atlow the user to take 


program cusps at warious stages of the reorganize process. 


Reorganization Rufes 


The fottowing dist of rufes identify the capabilities and 
limitations of the reorgenization. Rutes marked with en asterisk 
(*) character reaquire a change in the version stamps for the 
effected structures» (Refer atso to the subsection entitied 
Version Checking for a discussion of the changes which can affect 


the version stamps for existing structures.) 


The fotlcowing recergarnization rules require a change in the 


version stamps for tte affected structures. 


Accing Cata Items 
Data items can te acded to existing data sets. These new 
items can be adcec to the fixea format part as wel! as to 
the variable format part. New items snithin the fixed format 
part of a data set can be REQU&RED or used as a key item if 
an INITIAL WALUE ctatse is included ir the description of the 
item. If no INITIALVALUE appears in an item description» a 
syntax error is generated when the item is either dectarec 
with the FEQGUTIRED keyword» or appears in a KEY clause. New 
items acded within zz variable tormat part of a data set 


record car be required tf an INITIAL VALUE ts inctudec in the 
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descripticn of the item. 


Poving a Data Item fron Fixed to variable Format 


An item can be aovec from the tixed format part to a 


variable format part within a cata set record. The data 


contained in thet item is tost in any déta set recorc which 


does not contair the proper variable format part. Items 


cannot be moved fror one variatie format part te ancther 


wariable format part. 


Celeting Date Items 


Data 


items can te deteted from existing data sets. 


Changing the Descripticn of Data atems 


Data item descripticns can be changed as fottlows: 


1. 
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Fielc lengths can te tncreased cr cecreased» inctuaing 
the fraction ard integer parts of numbers. (Key items 


cf ordered manvrad subsets must not be changed.) 


Signs can tke acded to or aropped from numbers. (Key 


items cf ordered manuat subsets cannot be changed.) 


Cecurrences car be changec Cincreased or decreased). 


Item types can be changed except for RECORD TYPE iteas. 
The tength of the RECORD TYPE fietd can be changed. It 
is the userts responsibility to avoid any problems or 
agbticuities which sight arise from decreasing the 
dength of a REfTORD TYPE faetde. (Key items of crcerec 


wnanuat subsets cannot be changed.) 
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Changing Groupings or tevels 
The groupings ard/or levels can be changed» The items must 
be used within the tcope of the same data sets in the otd 


and the new data bate. 


Changing the Ordering cf Data Items 


The ordering of the items can be changed. 


Changing the Descriptiens of Sets and Automatic Subsets 


1. Sets and attometic subsets can te deteted. 


2- the cuplicsetes clause can be changed. 


3.2 CECata items can be added to» or deleted from» a key 


specification. 


4. The crder cf tte key items can be changeda 


Se Ascending znd cescending specifications on key items 


can be chargeds 


6- Index sequentizt sets can be changed to index random 


sets or automatic subsets. 


7e Index rancem sets can be changed to index sequential 


sets or automatic subsets. 
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6. Automatic subsets can be changed to index sequentiat 


sets or incex random sets. 
9. The WHERE ctlaute can chanye on e2n automatic subset. 


Eebeddedc Data Sets and Manual Subsets 
Embedaec cata sets @¢nd manual subsets can be deleted. The 


verston of the farert data set 15 changed. 


Embedced cata sets end manual subsets can be changed from 


ordered tc unorcerec or from unorderec to ordered. 


Key specificaticns can be changed on ordered emtedded deta 


Sets. The atiorabte changes inctude: 


1. Cata items can be added to or deteted from a key 


specification. 
Ze The crder cf tle key items can te changed. 
3e The cupiicetes clause can be changed. 


4. Ascending gna cescending specifications on key items 


can ke charged. 


WHERE and VEFIFY 


WHERE and VERIFY corditions can be changed. 


When comparing the VHERE and VERIFY clauses» the DMS/DASDL 
compiter checks firet for an igenticat expressions anc if 
that cogparison fails» the compiler then checks for an 


equivatent expressicne. Because of this» compile times are 
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increased if any of these ctauses are changed» even if the 

resuitant clause is equivatent to the original. Dependinc 

upon the size» rumbers and comptexity of these clauses» the 
increase in CMS/CASTL compite time can tecome substantiais 

therefore» the user should avoid unnecessary changes to 


these clauses» 


The foilowing recerganization changes do not require & change in 


the version stamps fcr tte affected structures. 


Accing Sets anc Autogatic Subsets 


Sets and automatic tubsets can be added. 
Accing Esbedcec Tata Sets and Manual Subsets 
Changing Pecpulatiors 


Chenging Structure Attributes 


The follosning structure attributes can te changed. 


AREAS 

AREALENGTH 

SPLITFACTCOR (reorganization not required) 
TABLESIZE 

WCCULUS 

BLOCKSIZE 

FAWILYAN AME 

TIILE 

SECURIT YIYPE 

SECURITYUSE 
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Carbage Coitection 
Any structure which exists in toth the old and new cata base 


can be garbage coitected (generated) or purged. 


Cata Vransfornations 


Curing the reorganizétior process» uata items within a data set 
can change in size» types offset» and number of occurrences» 
subject te certain restrictions which are ciscussed tater. In 
corcer to appear as a charge (rather than as a celetion and 
adaition)» the item aust appear in the same cata set in the alc 


énd new cata bases. 


Addition and Deletion cf Data Iteus 


Cata items can be adcec to or deleted from the description of 2 
cata set. then a data item is deleted» the cata asscciated with 
that ites is rewcwed fros adil recoras in the data set.e- When 2 
cata item is acded» a data field containing high-values (Cnutt) or 
the vatue specified in tte INITIALVALUE clause is insertec intc 
eal records in the deta sete For this reason» items which are 
~edcec canret be usec as teys or be required fieldser unless they 


have INITIALWALUE cléeuses. 
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Item Size Changes 


Cata item sizes can te ctanged»j If the new size is greater than 
the cid size» then a filler is addea to the fielc in accorcance 
with the rutes outdirec in tabie 3-i- Conversely» if the ner 
size is fess than the otc sizes then data is truncated from the 
item. This conditior is detected by the DMS/DASDL compitder anc a 


nharning message is generzted. 


Signed Data 


Sign fietds can be acded to or deleted from a cata item. 
Celetion cf @ sicn fielc is cetectea by the OMS/DASDL compiler 
enc &@ warning sessage is generated. A positive sign is generated 


for existing items which have a sign added. 


Cccurrences 


The number of occurrence’ of a data item can be changedj If the 
rugber of cccurrences derreases in the new data base» onty the 
tirst nm occurrences are noved to the new record» where n is the 
rusber of cecurrences of the data item in the new data set 
recorde This condition is detected by the DMS/DASDL compiter éend 
a warning messsge is generated. If the number of occurrences 
increases in the new dat@ base» only the first m occurrences hzve 
cata moved inta them fron the old data set record» where m is the 
runber of ccecurrences of the data item in the old data set 


record. The remainirg cccurrences of the item are set tc nuit. 
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Cecurs nesting can ge to three teveis in the DMS/DASDL source 
file. Uf an item is nested» its number of occurrences can be 
computed by muitiplying the number of oxcurrences of all its 
cuter teveis. All data items are transformed on an elementary 
level basis- If a change is made to the numter of occurrences at 
the group devel» thit hat the effect of chancing the numter of 
ccecurrences cf atl of the elementary items within thet group» éend 


transformation is core or that basis. 


fegrouping of Data Iters 


The groupings and/or ievets of data items can be changedr subject 


to the fcllowing restrictions: 


i. Regrouping of cata items cannot cause data to te 


dupdicated. 


Example: 
Old Grouping New Grouping 
A GROLP A ALPHACZ)>» 
(CB ALPHA(1)3 B ALPHACI)> 
C ALPHA(C1))5 C ALPHA 1)> 


In the exagple above» the data represented by A is 
duplicated in the rew definition since B and C both contein 
data contained in *. Therefores the above regrouping xould 


not te altowed by the DMS/CASLL compiter. 
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Ze Regqrcugirg of items cannot cause multiple mapping of 
information into ar item. Thais reqrouping would occur if 
the new cefinition were transtormed into the old definition 


in the previous exemple. 


Item Type Changes 


Item types can be changece The onty restriction here is that ¢ 
cecigwatl or signec decimal item cannot be changed to an elementary 


atcha item (a COBOL rutel. 


Data Transforazation Rules 


hhen the OvMS/DASOL ccapiter detects that an item must be 
transformec» it effectively generates a MOVE which conforas to 
the COBOL conventions. The rutes for data transforaations are 


Shewn tn tabte 3-2. 


Tabte 3-2. Data Transforeations 
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Truncation or j 
{ Space izero !IZero nimuneatercanere ce (leanstste 


mm 2 ae ae ve ae 


Mmm e Saas es a oe 


Mcve 1 Fitt Fite VU 1 Sign TPositivel 

SSS TS SSH Seesaw ae eS eT (On f on 1 on 1 1 Sian 
Frow 1 Tec t Right MRignhtiLeft I | 
SSC mGo SS SSS SKS SSS SS Set SSS SSS SS SS SSM TST SS SSS SS SSIS SSS Tse Sse ss Ss STs s sss 
Croup l€roup 1 x 1 1 1 i 

Group Atcha 1 x i i 1 j 

Croup iSicned irt.l ix | 1 { x 
€roup linteger | 1 x 41 | { 

Grcup Signed dec! i x 4 i j x 
Group lCecinat | 1 x 43 1 | 

wredimian saw me {onan eee em | emweren foowen [son ene | ceesewoejocewnen 
Atphe 1€rcup | x i 1 j i 

Aipha fAlcha i Xx 1 1 1 | 

Aicha (Signed irt.l 1 1 x 4 i x 
Alpha linteger | | i x | | 

Aipha iSigned dec. i $x 4 | Xx 
Atpha iCecimal | | 1 x | 1 

Sm ine ae ae oe SSS esas sss se] +e eee ee | wee ee] seas [ee Sen ee={ =< <5 «5 
Signed int.tGrcup 1 x | 1 i x i 
Signed int.lAtpha | x | 1 i x 1 
Signed int.iSicned irt.! i i x» 4 | 
Signed int-lInteger i j { x 4 x i 
Signed int.»«lSicned dec. 1 i x 4 | 
Signed irt.§iDecinat 1 1 i »x 4 x 1 

je ia ooo (aa Se ee a | See ean fae] Seas | eee aa ae eae e a Se 
Integer lGrcup | x 1 ] { i 
Integer Atcha i x { i ! 1 
Integer Signed intel 1 1 x 1 i x 
Integer linteger 4 | + x 4 1 
Integer iicgned dec.! | 1 x 4 i XK 
Integer ifeciwat 1 1 i x 1 | 

Se SAS Ae ee ee ees ees ee eee a 1 <s<2 {ees 6s [ese es eee Sees SH 
Signed dec.wlércup 1 x 1 t j Xx i 
Signed dec.tAipgha f4Errors#] i 1 i 
Signed dec »lSiqned irt.f I ' x. 4 ! 
Signed dec.linteger { 1 1 x | X 1 
Signed dec.~tSiqned dec.i 1 ' x 1 4 
Signed dec»ziDecisgalt 4 i ! x 4 x I 

se anise 66 [as ss eese ee [saa ee es (eae ae] a See S ] ee eee ee fe ee es 
Cecigal {Croup q x 1 1 i i 
Cecimad Alpha i*Errorsi i ] 1 
Cecinal {igned irt.] ] i x 4 j x 
Cecimad linteger | J i x 4 i 
Decinad tSigned dec] j 1 x { X 
Cecival ifeciaal 1 1 ! x 1 | 

int. = integer 
dec. = decimaa 


wee hw wT 


Version Checking 


Fach structure and remap has associated with it a version which 
reflects the last time that a change was made to the togical 
cescription of that structure. For programs containing 
cescriptiors of that stricture with an eartier versicn» a version 
error results if an atternpt is made to use that program to access 
the alterec structure. § recompilation of the program is 
recuired to bring it up to date with the current description of 
thet structure. This recompitation must take place 2fter the 
successful ceapletior cf the reorganization process». The version 
of a structure is cortaired in the dibrary file which describes 
that structure and the library files are not changed until the 


successful completior of the reorganization process. 


Some of the changes that are attowatte with reorganization 
require that the versions of some of the structures change. The 
user must te akare of any changes requiring recompilation cof 
existing programs anc the magnitude of the recompitation effort 


required tefore saakirg ary changes to the data base. 


The rules which determiné version changes follow: 


1. If ary of the cata or group items in a data set change or 
the vwERIFY clatse changes» then the version of that cata 


set and ald sets ard subsets that reference it change. 
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Ze If a set or sutset togical description changes then that 


set cr subset version must change. 


36 If the WEERE cecncition on an automatic subset changes then 


that subset versior must change. 


4 e If an embedded datz set changes from ordered tc unorcerec» 
or from unordereco to ordered» if any of the data or group 
items in the deta set changes» or if the key items cf the 
access set charge» then the version of the embeddec data 


set must change. 


In summary» ati of the reorganization rutes marked with an 
asterisk (8) require a version change» and any user programs 
accessing structures whote versions have changed must te 


recogpited. 


Garbage Coliection 


Curing the noraatl upcatirg of a data base the efficiency of the 
cata base can detericrate» both in terms cf the number of I/O 
operations requirec to access parts of the data base and tke 
amcunt of wasted disk spzecee The benefit obtained fros garbage 
cotlecticn is a function of the type of structure (disjoint data 
set» index rancom set» irdex sequentiat set or subsetr embeddec 
cata set» cr manual subset) ano of the dynamic entry of céta. 
Gartsge collection is performed automaticadiy on any structures 
which require reorgérization. The need for garbage collection 


enc the result obtairec gre described» by structure type» in the 
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following paragraphs. 


Cisjoint Data Sets 


The algorithas used ty tte DMSTI system to maintain disjoint déta 
sets do not have a mecharism for returning file areas as the 
rugber of valic records tecreases. Thus» if a data set once 
included a very targe nuwber of records» but the population of 
the cata set has since returned to a more typical size» none cf 
the cisk areas woutd be returned to the operating system CMCPII). 
The cetetec records «gre tvaitable for reuse but may never tbe 
reeded» Garbace cottection returns the excess disk greas tack to 
the cperating system (MCFII). <Atso» it optionatty orders the 
records by an existirg irdex designated by the user. If a 
cisjcint data set is gartage collected» then ati the sets and 
subsets that reference that data set are atsa garbage cottectec 
{the addresses which they contain must all be changed to reflect 


the new record tocations).~ 
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Incex Sequential 


The algortihas used by tte DMSII system maintain balanced index 
sequentiat coarse anc fire tables. The number of entries per 
tatde is kept betweer the vatue of JABLESTZE and TABLESIZE - 
SPLITFACICK. Little is étccoaplishea with the garbage cottetion 
(generated) of an incex tequentialt sets however» a purge 
cperation rebuitds the set from the data set. This can eliminete 


eny INTEGRITYERRGR exception conditions. 


Incex Randoa 


The algorithms used ky tte DMSII system to maintain an index 
random set do not take acvantage of deletec entries in the base 
tables to corsctidate any overftow. Aisoso overflow tabties which 
have become empty are never returnea to the system. Garbage 


cotlecticn performs Eoth of these functions. 


Lists (Manuai Subsets end Eabeddea Data Sets) 


The algorithms used to stintain Lists dynamicatty return empty 
records to avaitiable space within the file. However» the excess 
cisk space is never returned to the system. Garbage collection 
returns the excess disk tpace» consolidates the List in @ mininunm 
number of records» ard groups recoras with the same parent in 
cortiguous blocks» Any time a tist is garbace cottlected» the 
parent structure is ~tso garbage coalected to change the list 
head pointers to reflect the new list record locations. If a 


manuel subset must have its addresses adjusted because the otject 
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cata set was géerbage cotlected» then atl of these functions 
except the garbage cclttection of the parent structure ¢giso take 


places 


Finatly» atl manual subset entries pointing at deteted records in 
the related data set are removed. <similarty» if the key items 
within an entry of ar orcerec manuat subset do not match the 
corresponding key items sithin the cbject data set records the 


entry is removed from the manuat sutset. 


File Nasing Conventions 


Eoth DMS/CDASOL and CDCeS/REGRGANIZE generate a number of temporary 
cisk files that are used during the reorganization process of ¢é 
cata basee The user showtld aveid naming the files in such 4 wey 


as to conftict with the rames of these temporary fites. 


A temporary cory of the cata base dictionary has the following 


names 


*«datacttasepack>s2<«new data base name>/DICTIGNARY 
The <datasbase*pack> and <new data Lase name> come from the 


CCwPILE statement specified in the iEMS/DASCL compitlaticn. 


Structures that are retuitt through DMS are created in files 


ranecs 
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2<new cata base rame>/REORG=<stsucture number> 
These files resice by cetault on the finad medium tut can te 


reassigned with the COPY statement. 


The tape file is named RFORG/<old data base name>. 


The tibraries gre be asseciated with the new data base after the 
CMS/CASOL reorcanize run have the fotlowirs naming conventions. 


CCECL tibreries are namec: 


<data base pack>/s3<new data base name>/<structure name> 


FPC libraries are naned: 


<data btase pack>/4*new data base namer>sX structure nage> 


The reorganization centred file created by OMS/DASDL» which 
cescribes the reorganization operations to DPS/REORGANIZE is 


nameq: 


<data base pack>/2<new data base name>/REORG-CNTL 


The XREF file» if needed» is named: 


2*«new cata base rame>/XREF 
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The WREF file resides cn the system pack by default but can be 


reassignec with the INTEFNAL FILES statement. 


Atgorithes 


The CMCP» cr OMS Access Foutines CDMS/ACR)» is used for most of 
the fide creation perforned Cy the uMS/REGRGANIZE program. 
However» there are severzt special aigorithns implemented in the 
reorganization program te provide functions that are not 
availabte in the OMSII system» or to increase efficiency cof 
frequently used functions. The details of these algorithms are 


cescritec in the fotdowirg paragraphs. 


Index Sequential 


Cne such atgorithm is used for the talancing of an index 
sequential set. The batlencing is called for when the GENERATE 
<set> USING <set> syntax is used» of if only the block or ezrea 


size has changed in the rew index. 


Jo balance the index seqtentiat sets» the CMS/REORGANIZE prograr 
reads most of the olc anc new file paraseters directly from the 
cictionaries» rather thar using the ones in the controt file. It 
first buiics the new fine table tevet froe the old fine tables» 
fozding each table SFLITFACTOR fudi.e If the addresses are to te 


fixec up» then this is dene as the tine tables are loaded. 
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Each higher tevet is meade by reading the previous tevet and 
faking another tevel that indexes ite again fitting the tables 
SPLITFACTCR fudt Catthouch the fast tabte in each level may te 
more or tess full). This is repeated for as many tevels as 
required urtit one tabte ts created on a dewet. This table 
tecomes the new root table» and the next table contains the new 
NA and HC. These values are placed in the Fite Control tabte end 
the cictiorary fixer puts them in the new cictionary at the enc 


of the reorganize orccest. 


Index Randoa Sets end Few Index Sequentiat Structures 


When a new index structure is added» or when keys are changed on 
ar index structures the [MSII access routines in the operating 
system are usec to buiid the new index. First the structure 
records are adjusted to tndicate that only the changed index is 
to be built. At the comrietion of the operations the structure 


records are correctece 
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Abnormadt Conditions 


If an error cccurs white performing the reorcanizaticn of a data 
tase» the reorganization program terminates. The termination of 
the reorganize progréem czn be initiated externatty Cprogram 
abcerteds ctlear/starts» anc so forth) or internatty. When 
internatdy initiateds the reorganize program notifies the user 
whether cy not it car be restarted. In general» when the 
termination is exterraity initiated» the reorganization is 
restartabte. Specifically» the reorganizaticn process can be 
restartable» depending uron wvhich of the fottlowing categories cf 


aebnormat ccnciticns ccecurs: 


1. Cata base cescription errors. 
Ze System hangs. 

3. T/C errors. 

4a Recrganization procram errors. 


Cf these» the first catecory (data base description errors) 
carnct be restarted» the seccnd category (system hangs) can be 
restertec» and the test two depend upon the exact nature of the 
problem. An I/0 errcr cin normaity be restarted» untess the I/6 
error is on the tempcrary data base dictionary» taheted 
é<catatbasesname>/CICTICNARY or a write error occurred in the nen 
cata base~e Program errors due to insufficient dynamic memory or 


overlay cisks» for exampit» can be restarted. 
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The reorganizaticn procets has two phases. In the first phase» 
the rew data base is built and no modification is mace te the 
existing cata tasee In the second phase» the reorganization 
reroves» acdifies» and acds fileso If the reorganization 
terminates ir this seccn«e phase and the reorganization is not 
restartablers the user car reload his backup copy of the cata base 
ious rerunning the reorganization or continuing to process 
against this data base. The user can identify what phase the 
recrganizaticon was ir ty exawfining the printer output file 
created by the DMS/REORGENIZE program. If this is not availsbie 
(due to a clear/start) tte ODT log may be inspected for the 


fodlowing sessage; 
aaee BECIN FILE MODIFICATION aeax 
NOTE 


This message orly e*tppears if the OMS/REORGANIZE 


prcogra@ was executed with program switch 3 = 1. 


This message indicates tte reorganization process has begun phése 


TWO e 
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Non "Restartabie Conditions 


If a nontrestartabtle errer occurs during the reorganization 
process» it is the user*: responsibility to quarantee the 
integrity of the existine Cotd) data base before attempting 
reorganizaticn againe Tte action taken by the user to insure the 
cata base integrity ceperds on when the condition occurs (Cas 
incicatec cr the prirt files produced by the reorganization 
programs)» and what type of error actuatty occurs. The integrity 
cf the existing data baste can be restored by either cf the 


following: 


j. Doing nothinge The reorganization program discoverec the 


error anc has marked the old gata base as usable. 


Ze Restoring the cata base dictionary. The reorganization 
program cid not citcover the error Cfor exampler the 


programe sas abcrtec). 


If the abnormat concitior was a data base cescription errors the 
user must also make zpprepriate changes to the DMS/DASDL source 
file before attermotirg reorganization again» Possible 


cescription errors are: 


i. Duplicates occirrec but were not specified as altowed in 


the new cata bese 
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Ze A LIPITEPROGR occurred cn a fite tn the new data tase Cfor 
exemple», the maeximam tevel of coarse tables was exceeded» 


or maximum file size was exceeded). 


oe A CATAERROR occurred because of a failure to meet the 
RECUIREDs WHERE» or VERIFY conditions specifiec in the new 


cata basé» or &@ vatiable format record type was wrong. 


If any of these cescription errors occur during reorganizations 
the Lata Bése Administrator (D68A) must change and recompile the 
CMS/DASDL source fite» or correct the offending records in the 


cata base to begin tre reorganization process againe 


Restartabie Conditions 


If» curing the reorganizetion process» an exception occurs which 
is restartabie» the tisting generated by the reorganization 
trcgram shcuild be corsultead to determine what phase of the 
reorganization was ir precess at the time of the exception and 
what actions» if anys need to be taken befcre re~executing the 
CMSVFECREANIZE progrem. The fottowing paragraphs descrite the 
possible situaticns shict might arise and any additional action 


which the user may heve to take: 


1. If a specific structure nas being reorganized» either 
because cf an expticit GENERATE» or because of a change in 
the cescriptior of the structure Cincluding ait changes in 
the fogical descrirtion of the structures ana ati changes 


in the physical cercription except a change to the number 
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of areas for ar existing files» no additional action neecs 


to be taken» fFen~medecute the UMS/REQRGANIZE program. 


2 If the DweS/REOGFGANIZE program was in the process of 
changing the number of areas tor existing files {the 
message EUMP AFEAS FOR «str#> appears in the tisting 
followed by one ofr more file namess the message END BUMF 
AFEAS FOR <stra#> dees not appear in the listing)» then alt 
of the files which were to have their areas chéenged must be 
restcred toe their trereorganization state. This change 
only appties tc files for which the cnty change was to the 


numter of areas. 


35 If the excepticn cendition occurs after the DMS/REGRGANIZE 
prcgoram has renovec the otd data base dictionary» but 
before the name cf the temporary dicticnary has teen 
changeas tha user can change the names» and it is not 


necessary to restart the reoryanization programs. 


Systen Requirerents 


Cepending upen the specific functions of reorganization being 
requestec» the demancs ufon the system in terms of memory» time 
anc cisk space car be extremety high» Users should he aware of 
these requirements before attempting a reorganization which may 
rot te abide to complete in a given time frame or which requires 
wore disk space cr memcry than 15 on the system. The 
requireserts fer reorganizations includince aemory» timer and disk 


spéeces are discussed in the following paragraphs» in terms of the 
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type of reorganizaticn te be done. 


Furge 


The impact of purgine a ¢tructure is minimal. The purge process 
normatty ccnsists cf opering the first area of the file 
containing the structure and adjusting the Next Avaitlatte and 
Highest Cpen CAAHOD) information for that file within the data 
tase dicticnary. For incex random structures» adit base tabtes 


ere initializec. 


Feorganitzation of 2 Data Set or Manuad Subset 


Reorganization of a cata set» whether caused by a change in the 
cescripticr of the déta tetr or by an expticit GENERATE» results 
in the unicacing of the cata set from the otd data base and 

reloading it irtc the nes data basee This procedure is used te 
reorganize both cisjcint and embedded data sets- Additionally» 


manuet subsets are urloaced from the otd data tase and retoacec 


into the new deta base. 


The amount of times cisk spacer and memory required for this 

crocess is approximatety the same as if tte user were to write 
pregrams te undoac and retoad the data sete» aithough there are 
some tools available to the user to reduce these requirements. 


These toots are ciscussec in the foalowing paragraphs: 
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1. The CMS/FECRGANIZE procram is very sensitive to dynamic 
merory and shouttd te executed with @s much memory as 
possibte. Wher setting the dynamic menory for the writer 
prcgram» however» the user must consider the amount of 
memory on the system» as well as the arount of memory 
required by the CMSIIT system to process the two cata bases 
which are active at the time of the reorganization. (eter 
to agppencix E cf this manuat for a discussion cf the memory 
required by the CMEII system to perform various functions 


on a data base). 


Ze There must be two copies of a data set present on disk at 
the tise of the recrganization process. If there is 
insufficient disk tpace available on the disk pack on which 
the cata set file rormally resides» an intermediate work 
file can be assigned to another disk pack» by using the 
COPY syntax. If stace restrictions are severes the COPY 


BACK or COFY TTC TAFE syntax can be usede 


The time requires for a reorganization of a data set should te 
slight@y icnger than that of the originat load» but stitt on the 
sane order of gwagnitude.e. The factor which determines ton much 
longer the reorganizatior takes is the number of sets and subsets 
which reference that datz set» since the acdresses must be 
correctec after the cata set has been rebuilt. This address 
fixup is performed using simple reaas and writes on the cisk 
fides containing the tist» and reads of the XREF file created 


curing the generaticr phase» Speed depends upon tahlesize>» 
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blocking» and entrysize cf the relevant sets and subsets. 


Batance of an Indea Set or Subset 


As in the case of recergarization of a data set» there must be 
encugh disk space avzilatie to hold two copies of each file to be 
balanced. If there is irsufficient disk space avaitabier an 
intermediate work pack cen be specitied to the D¥S/DASOL compiler 


using the COPY syntax. 


1152444 3-39 01/19/84 


SECTION 4 


ACDIT AND RECOVERY 


The CMSTI audit and recowery system consists of the code within 
the cperating system (MCFII) which audits att updates to a data 
tase» and the CMS/RECOVEFDS program which processes this audited 
information to restore tte integrity of a data base once that 
integrity has been ccmpremised whether by a user programeing 
faiture» system error» or hardware maifunction. Aadditionaily» 
aucit and recovery is designed to accomptish this task tr much 
less time» and with guch tess user programming or operetionatl 
effort than soutc be reqrired by any usersritten recover y 


cErccedures =. 


The retevant elewents of the DMS/DASDL source fite and the CCSCL 
source fide which are recuired to iaplement gudit and recovery 
for a OMSIi data base» ard which have already teen descrited in 
crevious sectionss are described in greater cetail in this 
sectione In acdititons tte various types of recovery and the 
implications of each type are described. Finaitty» some 
recommencations concernirg the use of audit and recovery in 
various system ervircnwerts are inciuded in the subsection titled 


Festart Preccedurese 
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SYATAX ELEMENTS 


The elenents of the ([MS/TASDL syntax necessary to implement sucit 
enc recovery in a CMSiI cata base» as descrited in the 8B 1000 
Systems C¥SEI Cata and Structure Detiniticn Language (OMS/CASDL) 


Lanquage manual» are as fotiows: 


1. Audit trail. 

Ze Restart cata set. 
7. Transact tons. 

he Syncpoint. 

Se Corntrotpcint. 


Each of these items is described in detail in the fotiowing 


Faragraphs. 


Audit Trait 


The gudit traid is a history of att updates performed on a data 
bases it consists cf a file» or series of files» containing one 
record fcr every charge to the data base. fhe first eight bits 
of each record is a tietc which represents the type of change 
keing auditede Except fer control records (those representing 
cata base CPEN or CLOSE» SYNCPOINT» CONTRCLPOINT» or PROGRAM 
ABCRI ~ these records corsist of just the TYPE field)» this 
record type is repeatea et the end of the record. This 


repetition enabtes the C#S/RECOVERDt program to read the audit 
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trail either forward or tackward. fFoltowing the TYPE fieta is an 
é-tit fielc cortaining the number of the structure being updated. 
Again» this fietlc is repeated at the end of the records just 
prior to the TYPE field. The remainder of the record is variattle 
in dength cepending upon the structure type end the actuat change 
taking places. For example» when a new record is added to @ data 
set» the audit recore detcriting the operation requires four 
tytes for the address of the new record ptus the actual record 
being adcede To audit tte update of an existing data set record 
requires the 4-byte gdcress plus copies of the record before and 
after the upcate.e. Te aucit the insertion of a key into an index 
recuires 13 bytes of controt information (Czé@ Setyte address which 
specifies the tocaticn of the new key within a specific index 
tatie» a 4"byte address for the cata set recerd which contains 
that key» anc four bytes for an audit serial number) pius a copy 


cf the actual keys 


In creating the audit trzii» there ere usuatty severai distinct 
changes to the data Ease» and therefore several audit records» 
for any singie DMSII updéete aperation (stores detete). For 
examoler when a new recotd is stored in a cata set» the OMSII 
system must aucits tn accition to the simpte store of the record», 
such things as the sgace adlocation for that records the 
insertion of the key fields into ati of the paths which refererce 
that recorcs and any index table attocation or table splitting 


which is cone to complete those inserts. 
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Cperétionaity» the CvSII system uses two tuffers for the audit 


trati» which are written out automatically when they are fidiec. 


NOTE 


Whide switching aucit files (closing the current file 
and opening the nest one)» the DMSII system can 
ailocate overflow tuffers for the audit trail. This 
enables the coaptetion of update operations which are 
currently in process» so that programs can continue 
to perform inquiry operations against the data base 
while the file snitching is in process. As sSagon as 
the file suitcting ts compieter any filled audit 
buffers are writter to the new files ail overfion 
buffers sre then dealiocated a5 soon as they héve 


been written ort. 


Adcitionailys when a syncpoint occurs» any ucdeted audit buffers 
in memory are sritter out whether or not they are full. Refer to 
the ciscussicn of syrcpoints in the subsection entittlec 


SYNCFOINT. Aucit records can overtap physicai blocks. 


The audit trait can te atsignea to either disk or tape. If disk 
is to be usec» then the cisk pack or cartridce on which the aucit 
trail resices shoulad not contain any other data base files since 
the failure which corrupted those files coutc atso corrupt tte 


eucit trails making recovery impossible. 
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Festart Cata Set 


Every data base which uses audit ana recovery must include 
exactly one restart cata set. This data set is physicatty the 
Same as ary cther data set and is treated és a simpte data set by 
ctoth the CYSII systes ane the CMS/RECOVERDS program. Logicattly» 
this data set is the mears by which a user progras can determine 
if a recovery has occurred and to what point the data tase has 
teen recovered. Adcitioraity» the user data fields within the 
restert record are tc be used to maintain the informeétion 
necessary to restore the program’s own internat cata to the point 


of the recovery. 


Transactions 


A transaction is a seriet of OMSII operations which can or cannot 
update a data tasee Wittin a@ user programs this series of 
cperetions must tegir with the begin transaction 
CBEGIN“TFANSACTICN vert in the COBDL and CGBOL?74 tanquéeges and 
TREEG operation code in the RPGII tanguage) operation.» Upon 
execution cf a begin trarsaction operation» @ program is in 
transaction state» 4 pregragr must perform atl of its updates to 
an audited data base while in transaction stéete.- To leave 
transaction state» a procram must perform an end~transection 
CEAND"“TRANSACTICN wert in the COBOL and COBOL74 tanguages and 
TRENT operation code in the RFPGIT tanguage) cperation. 


Irensaction state is usec for the following functions: 
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Cogpletion of a Sirgie Transaction 
A program uses the endattransacttion crperation to notify the 
DMSIIT system that a¥l of the updates shich comprise a sincle 
transacticn have conpteteae If a program aborts (goes to 
EGJ or is discortinved (05 or UP) by the operating system 
CMCPII) while ir transaction state» then the DMSII system 
assumes that a transaction is incomptete» therety 
jeopardizing the stetus of the data tases therefore» the 
DMSIT system must merk such a vata base as requiring 
recoverys An ECJ of O05 of a program not in transaction 


state dces not scsfferct the status of the data tase. 


Closing a Cata Wase 
No prograa can ctose the data tase» either implicitly or 


explicitly» white arother program is in transaction state. 


Frograg Aborts in Irantaction State 
If a €MSI1 program zborts white in transaction stete»s» the 
DMSII systea carnot attlow the UMS/RECOVERDB program to tegin 
white other procrams are stiil in transection state. Refer 


to the subsecticn ertittec Proyram Abort Recovery 


Aucit Functicn 
The CMSIL systea performs a store operation on the restart 
data set record of the program whenever the audit function 
is requesteco The zgudit function ts invoked for a 
begin =transacticn oreration by specifying the AUDIT cptior 
with the EEGIN“TRANSACTION veri for the CCBCL end CCECL?4 


languages and teavirg the FACTUR 2 field blank with the 
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TRBEG operation code for the RFGII language» The audit 


function is invckec for ar endttransaction operation ty 


specifying the AUCIT opticn with the END-TRANSACTION verb 


for the CCBCL ard CCBOL74 tanguages and teaving the FACTCE e 


fieidc blank witht the TREND operation code for RPGII 


programs. It is the store operation to the restart 


data 


recerc cf the progrem which alaows the program to séve any 


inforgwaticn that is needed to restart itself in the event of 


arececvery.~ Because of this implied stcere operations each 


program must establish a@ flockeg record xithin the restart 


data set by performing either a tock» create» or recreate 


operaticn prior to the first begin-transaction or 


end-transaction operation. 


NOTE 


As stated egbover»y the restart data set is 
treatec as a simple data set by toth the 
CMSTI system ard the OMS/KECOVERDS program. 
It is through this iepliea store operation at 
either begin transaction or end-transaction 
operation bith the AUDIT function set that 
the contents of the restart record get 
aucitec anc car be subsequently restored by 
the UMSYRECOVEFDS program as part of the 


owerali recovery process. 
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Counting Transacticns end Syncpoints 
The CvySII systes counts the number of transactions which 
have cccurreod ir orcer to perform syrcpocints and 


controtpoints. 


Syncpoint 


A synctpoint operation is a quiet points a time at which no 
crograms are in transaction state and updating the dzta tase. 
Sirce there is ne upcate activity occurring at this time» 
syncpoint operations serve as a point of references for toth the 
CMS1Ti system ard the OMS#VRECOVEROB prograam which insures that 
changes on either sice of the syncpoint are togicaity and 
furctionattly irdepencent of each others Refer to the subsectian 
entitled Forms Of Recovery for a description of the use of botk 


Ssyncpoints and contrecipoints ty the DOMS/RECOVERDB program. 


A syncpoirt operatior occurs when the number of transactions 
specifiec to the DMS/DASTL compiler have completed. The number 
cf transacticns per syncfoint can aiso be changed through use of 
the SM input message. Refer to the 8 1000 Systeas Software 
Cperatior Guide» Votume ir for information on this message» When 
the required number cf transactions has occurred» the DMSIT 
system writes a speciat syncpoint record toe the aucit trait anc 
forces any updated audit buffers to be written outs if any 
erograms are in transaction state» the syncpoint cannot cccur 
untid these programs have performed an endtransaction operaticn. 


Alsoe no program can enter transaction state until the syncpcint 
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operation has cogpietedce After the syncpoint operation has 
completecs the OWSII systes increments the syncpoint ccunts in 
orcer to determine utben the next controlpoint shoutd be 


performec. 


In acdition» the EMSII system forces a syncpoint operation 
whenever a program closes the data base» or when a program abort 
cccurse The programeer can atso request 3 syncpcint operation at 
an end transacticn operation. Each of these types of syncpoint 


cperatton is hancted in the aanner previous! y outlined. 


Finat*y» whenever the nurber of programs in transaction state 
returns to zero» the CMS11I system performs a pseudo syncpoint 
cperation. In this cases the syncpoint record is written to the 
aucit buffer ir wemery» tut none of the other syncpoint functicns 
cecurs. The aucit buffer: are not forced out» nor are the 
transaction or syncpcint counts affected. To the CMS/RECOVEFOS 
gercgram» this pseudo syncpoint operation is indistinguishabte 
from a true syncpocint operations so that tre amount of data 
tetween syncpoint operationse and therefore» the amount of date 
which might be backec out by a recovery operégtion can te 


significantly reducec. 


NOTE 


Aithough the progrézmmer shoula be aware of the 
existence cf pseudec syncpoint operations and their 
function in recucirg the arount of data which sight 


be tackea cut» the proqramamer shoutc not rely on 
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their cccurrence since it is not possitte to 
determine if of when a pseudo syncpoint operation has 
occurred» excerpt ir a single programaming 
environments it it also not possible for the 
prograamer to cetermine when an audit tuffer 
cortaining a pseudce syncpoint record is fulls and 


therefore written cut. 


Controtpoaint 


A controlpcint operation is 4 special type of syncpotnt operation 
which onty occurs when the syncpoint count has reached the numter 
specifiec to the CMS/ODASTL compiler (this parameter can also te 
Rocified by the SM input message). After the DMSII system has 
corpleted such a Syncpoirt operations it forces to disk a data 
tuffer updated prior to the tast controtpoint records tut not yet 
writtene Atso» the [MSI] system maintains a series of fietds» 
catdied the Next Avaitabte anc Highest Open (NAHD) fieitds» for 
each file in the date bate. These wWAHD fields are stored within 
the cata hase dictionary and controt the 2ttocation and 
ceatiocaticon of cisk file space. At a controtpoint operations 
any NAHO field updated prior toe the last controtpoint record cén 
giso be written cut to tte dictionary. These processes insure 
that no updatec buffer or NAHO fiela can rem2zin in memcry for 
more than two controalpoirt records without being written to disk. 
After aid of these write operations have completed» a 


cortrotpcint record is also written to the audit trait. 
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FORMS CF RECCVWERY 


The recovery programs nased OMS/RECUVERDB» is invoked by the RC 
ingut message-e Refer to the 8 1000 Systems Software Operation 
Guide» Volume 1» for syntax. At beyinning of job» this prograr 
rezds up the data base dictionary and determines from the 
information containec in the first segment» cailed the OMS 
GLCBALS» which of the following three main types of recovery 


cperéstion 38 te be performed: 


1. Program abort recoserye 
Zs clear/start recovery. 
36 Dump recevery. 


The operator cen request a form of recovery known as a 
partial cup recovery by specifying a List of files xhich 


are to be recoveret. 


Progras Abort Recovery 


A progra suave recovery operation is required whenever a program 
is aborted by the operating system «(MCPII) or goes to end of jab 
CECJ) white in transacticn state» khen this occurs» a4! inquiry 
erograms are suspended at their next OMSII operation and markea 
as waiting recoveryr the onty exception te this is the close 
cperstions which the DMSIT system adtows to comptete. The updéete 
pregrams which are net ir transaction state at the time of the 


creogram ebert are also suspended at their next DMSII operation. 
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Any update program which is in transaction state is ztitowecd to 
complete that transactior before being suspended.j If such a 
ercgram perforas an enattransaction operation with syncpcint at 
this times» an ABORT CMST#TUS exception is returned immediately 
anc the syrcpoint spencer is not gerforged. When ali prograas 
in transaction state heave performed an end-transaction oper aticns 
the CMSTGT system forces ¢ Ssyncpoint operations performs a 
rseuco"ctose operaticn cr the data Laser» and then generates the 
FC input messace.s. This tequence cf operations is the onty fors 


cf recovery operation nhich is automatically invoked. 


Upon reccgnizing a progrézm abort» the DMS/RECOVERDS program finds 
the endrof-fite CECF) for the current audit fite and processes 
tackward from that pcint» backing out all updates which cccurred 


between the orcogram ebort and the last valid syncpoint record. 
NOTE 


Since the CMSII] syttem forces a Syncpoint operation 
prior to the pseudcetclose cperations the 
DMS/RECOVERDS crogram expects a syncpoint record at 
the enc of the filee This syncpoint record is 
ignorec» as is the controtpoint which could have been 


generatec by this styncpoint operation. 
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All cf the updates mast te backed out for twe reasons: 


te There is no way to identify tne program responsibie for 2 
particular audit record or to singde out the recercs 


generatec by the program that aborted. 


Ze Ancther progras which was in transaction state at the tine 
of the program abort ccuid have processed data which was in 


some way affected ty the program abort. 


After the updated records have been backed out» the CMS/RECOVEFCOB 
program issues a special comaunicate to the cperating systea 
CyCFII) informing it that afi programs waiting for recovery can 
te restarted. Upon tein« restarted» ali of the current~record 
anc current“path poirtert of the programs are in a deleted state» 
as if the cata base fac just been opened. In additions an ABCRT 
CMSTATUS exception ts returned to every prograa which haa 
completec any transactior prior to the progréem aborts this 
exception is returnec at the next begin-transaction operation cf 
these programs or when those programs attempt to close the dzté 


tase. 
NOTE 


Whenever a procram receives an exception on any CMSII 
operations that operation has not been performed. In 
the case of an AEOFT exception» if tte operation was 

a kegin-transactior operations the procram is not in 

trensaction stzete. If the operation was a close 


operation» the datz tase is not closed.» The onty 
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variation from thit is when tke operation is an 
enawtransactior operation in which case the DMSII 
system completes tte end“transaction operations tut 
the upcate is subsequently backed out by the 
DMS/RECOVERTB program in spite of the requested 


syncpoint cperzetior. 


Upon receitct of an AEORT exceptions a prograg should flocate anc 
flock its restart reccrd and take whatever action its necessary to 
restart ttsetf» basec upen the information contained in that 

restart record. Procrame which opened the data base INQLIRY are 


not notified of the recovery operation. 


Khen any program attempts to open a data tase while a recovery 
cperation is requirec of in process» the OMSII systee suspends 
thet program either gt dzta base open time if the data base is 
inactive or at the first DMSI!I operation after the open operation 
if the data tase is currentty activee Such @ prograsg is 


reinstatec at the coaptetion of the recovery operation. 
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Clear*Start Recover y 


The clearvstart recovery operation as required whenever a 
clear/start cperation occurs while a data base ts teing updatec» 
or a FATALERROF Excertior occurs. when a program attempts to 
cpen such a data base» clear/start recovery is initiated 
autowaticaliy. For ¢ clear/start recovery» cnty those files 
which neec recovery gre eccessed. Previously» ait date tase 
files were required to be present for a ctlear/start recovery. 
For most clear/start reccvery situations» operator intervention 


is ne tonger necessary. 


As in the case of prcgras abcrt recoverys the DMS/RECOVERTB 
ceregqram must back out sil! upcated records between the end of the 
eucit traii anc the last syncpcint record. Howevers tecause ot 
the clear/start aperéetior» no close operation was performed on 
the cata base» as 18s done at a program aborts therefore» the 
recovery operation mest insure that all upcated records prior to 
that dast syncpoint cperztion have teen written to the data base. 
Since an updated CMS1I baffer can remain in memory as tong as two 
controlpocint operaticns tefore being written out to disk» the 
CeS/FECOVERDE pregqrar mutt process tackwara through the gucit 
trail until it has ercourtered tro controtpoint records or data 
base opens and then it reapplies ali changes from that point 
forward to the last synctfotint record. After that has been done» 
the CMS/FECOVEFDS pregran restarts any programs which can be 


waiting for the recovery operation. 
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Cusp Recovery 


A cump recovery restcres a data base to a given state bkLased upon 
a previous cepy cf tte deta base ana ati of the auacit files which 
were created betneen that copy and the desired state~-~ The copy 
cresent at the start of the process must represent an inactive 
cata base which was successfully closed. The copy cannot itseif 
require either program atort or clear start recovery. <A dump 
recovery operation might be needed for one of the fottowing four 


reesons:s 


1. A system faiture hes occurred which prectudes the execution 
of a clear-start recovery operation. The faiture coutd te 
a corrupticn of the data base dictionary or the entire disk 
on which it resides. An I/0 error on 2 write operation to 
any portion of the data base requires a dugp recovery to 


recover the data bzse. 


a Either a ctearsstart or program abort recovery has been 
unabte tc successfuily complete. For examptesr an I/C 
errors feac or writes has occurred cdtring the recovery 
operations or the zudit trail cannot be read or contains 
records which ere invalid. In the latter two cases» a dump 
recovery operation can only restore the data base up to the 
fast syncpcint reccra prior to the error in the aucit 


trait. 
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J A hardware faifure has occurred» corrupting some or atl of 
the cata basee This failure could have cecuwred at any 


tise» not just while the data base was active. 


4 An error in a grogram has corrupted datas and it is 
necessary to restore the data base te 4 point prior to tre 


execution of that rrogram. 


To initiate a cugp recovery operations the operator must toad é 
backup copy of the ertire data base» inclucing the data base 


cictionary» and then enter the RC input message. 
NOTE 


A data base shculd be tacked ups whether to tape or 
disk» cniy wher the entire data base is inactiver an 
attegpt to copy an active data base» whether it is 
opened ugdate cor irquiry» can cause the backup 
process to fait» or result in an unusabie copy of the 


data base after an apparently successful backup. 


The EMS/RECOVERDE porcgrar reads forward through the agudit trait» 
applying atl of the chantes against the oid data base Each time 
the CMS/RECOVERCE pregras encounters an enccof~file record in the 
aucit filer it attescpts to open the next sequentiatly takeited 
aucit file. If this file is not present» the foilawing message 


is displayed: 
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IF «<ob-name>/AUCI]Inarnon EXISTS» ENTER Yo ELSE N 
If the file recuestec cots not exist» the operator enters Ne» and 
the recovery process is complete. af the file does exist» the 
operator makes it present and enters Ys recovery proceeds at 
that point. If neither VYonor N is entered» cr if ¥ is ertered 
gnc the fide is stilt not presents the DMS/RECOVERDS progrem 
repeats the message» tooring until the appropriate response is 


entered arc/er the fite 15 present. 
NOTE 


Fecause of the mectanism which the CmMS/RECQVEROB 
program uses tc determine what type of recovery 
operation to performs if recovery is ever invoked 
unnecessarily» the CMSZRECOVERDS progrem attempts to 
perforse Gee recovery operations and the preceding 
message appears on the ODT immediately. The operator 
shecudd enter Ne catsing the DMS/RECOVYEROS prograr to 
terminate. At no time should the UMS/RECOVERDE 


program be discontinued (DS of DP input message). 


Tf CMS/RECCVERCB atorts with a stack overflow 
conditions or is discontinued because the operator 
erroreausly enterec YES when no other audit fite 
existed» then the cata base is marked as 
irrecoverable. Te override this» remexecute the 


OMS/FECOVERCB program with switch 3 = 1: 
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RC <datasbase-nzme>sSwiITcH 3=135 


This way» a dugp recovery cperation can be avoided. 


If a program abort recore is encountered» curp recovery operation 
is temporarity susperded» and program abort recovery must te 
performec. tkhen this is complete» aump recovery operaticn is 
resused starting witt the next audit file. Simitarty» when the 
C(MS/FECOVERDE cregras encounters the endtoffite record in tre 


eucit trail» one of three following conditions must te true? 


1. The last recorce in the file was a cata base ctiose record. 
ram The tast recorc w32* a program abort record. 
J The first record ir the next tile represents a continugtion 


of the file just processeds that is» the next file aoes 


not begin with a deta base open record. 


If none of these are true» it implies that a ctear/start 
cperation was the cause cf the end-of-fite record in the audit 
fite»s anc prograr abcrt recovery must be performed at this time 
(clear-start recovery is not necessary» since the chéenges tetween 
the last syncpcint recort and the prior tro controlpocint records 
have alreacy been apgliec).j After the backing out of the records 
is complete» the duBp recovery operation is resumed with the next 


eucit file. 
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If any coanciticn arises which make it impossible for the 

CMS/FECOVEFDS pregqras to proceed (for exanpiles a read error oan 

the audit file)» ther it must back out alt changes from that 

point to the tast syrcpoint record. The foltowing message is 

then displayed on the ODT: 
INCCMFLETE RECOVERY - AUBIT FILES WHOSE NUMBERS ARE GREATER THAN nn 
UST BE PURGED OCF RE®OVED NOW 


Ihe cata base is restorec only to the point of the error. 


Partiat ODuep Recovery 


The parttat dup reccvery operation is a special case of the dump 
recovery operation» shict can be perforred uhen the operator 
knows that only a sukset of the tiles within the data bases 
exctuding the cata hese tCictionary» need to te recovered» as in 
the case of a hardware fziture on a singte disk drive. Before 
initiating the partizgt dump recovery operations the cperator must 
foac the heckurp copies of the files to be recovered. The current 
cata base cictionary must be present» as weti es another copy cf 
the cictionary» tabelled <datasbasename>/OLD.DICT» which is of 


the same versicn as the fides to be recovered. 


To initiate the partial cump recovery operation» the tist of 
fides to be recoverec is appended tu the RC input message. The 
user must specify the conptete file name to te recovereds 
inctuding pack-ics» if the file resiaes on & user packs and deta 
base name. For exanples if the user wishes to initiate a partial 


cugp recevery on two files named FILEL anc FILE2 which reside cn 


1152444 4-20 01/19/84 


aouser pack nawec USER» znd the data base is named DB» the 
fotlowirg commanc is usecw Assuming the data base dicticnary 


resices on the systea packs the user enters: 


RC C& USER/VCB/FILEY USER/DA/FALE2 


Assuging the data base dictionary resides con a user pack named 


USER1» the user enters: 


RC CE ON USER! USEF/DOB/FILEL USER/DB/FILE2 
The CMS/RECOVERDS prcegrar onty processes changes against the 
structures stored in those files» automatically terminating when 
the specifiec fites fave been brought up to the same version as 
the remaincer cf the datz bases If either a ctearstart recovery 
or a program abort recovery operation is required at the end of 
the last audit file» it its performea against the entire deta 
bases If any condition cccurs which forces an incoaptete 
recovery» a4 full dump recovery operation must then be performec. 


The cata Case is unusable at that point. 
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Write Errors and Pertizt Duap Recover y 


A write error only affects a particular file and its tmmeciate 
offspring (for exampte» 2 write error on an index prevents 
upcating of its cata set? Processing against the rest of the 
cata base can continie. The write error can be cleared ty 
running partial dcump recevery against the affected structure. 
Ary atteapt to access a ttructure which has had a write error 


results in an IGERRCQF exception being returned to the program. 


NOTE 


A write error to tte data base dictionary stiil 
‘renders the entire data base unusabie and requires a 


fudt dump recovery-s 


THROUGHPUT CONS ICERATICNS 


Cepending upon the asount and types of update activity being 
performec on a data tase» the overhead invoived in auditing 
upcated records can tecore very substantiat. It is possible 
through the settings of the various physical parameters of the 
aucit system» to redice the total amount of overhead required to 
gucit a given cata bzse» thereby improvine total system 


throughput. The parameters which can be adjusted are: 
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Audit file media 

Audit tilocksize 

Curaticn of transactions 

Settings for syncpoirts and controtipoints 


Aucit Media 


The amount of time spent waiting for audit buffers to te written 
car comprise a significart amount of the totel audit overhead. 

It is possibte,» through the settings for syncpoint records anc 
eucit blocksizes» to recuce the number of srite operations which 
ccecure In acdition» to sinimize the time actuaity spent waiting 
for these I1/C€ operations to complete» the audit files can be 
essicned te whichever avzilable device has the highest transfer 
rate», anc in the case of disk» whichever cevice tas the feast erm 
movement and retatioral cetay (latency rate). If there is a disk 
crive available whick has no other data bese files assigned to 
it» the gucit files can te assigned to that cisk. It saqnetic 
tape is to be used ard tte tape drives have varying transfer 


rates» the drive witt the hiachest rate stoutda be used. 
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Aucit SBiocksize 


Cne major effect of the fize of the audit tlock is the frequency 
with which nonsyncpcint write operations of the audit buffers 
cccure As the size cf tte audit bhiock decreases» the prokabidity 
increases that any given audit operation can fill an audit buffer 
(forcing it to be writter out). If the otter audit tuffer is 
aiready in the process of being written out when the current 
tuffer fills» then tte C*SII system must wait for the first I/C 
operztion to ceamplete before it can proceec.e For examples assume 
arestart data set recorce 200 bytes in Length. Since aguditing of 
en update to a data set record includes a tetfore and after iImace 
of the records» the begin transaction and end“transaction 
operations atone consuge over 400 bytes each in the gudit trait. 
Even with a sinigum amourt of updating within a transaction 
operations the defauit ardit bdiocksize of 1800 bytes can be 
fitled by as few as two transaction operations. Thereforer in 
order to minimize the nusber cf physical srite operations to the 
aucit trait as weil «es the acditional overtead required to 
altocate and maintain overftow audit buffers» the cefault setting 
fer blocksize shoauid be the absolute minumum used~s If the 
setting is much tess thar this» any single transaction can 


conpletety fila’ an ardit buffer. 
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A second major effect of audit buffer size is pariehe length of 
time required for syrcpeoint 1/0 scperations. Optimatiys syncpoint 
I/f operations shoutc gererate a smail percentage of the total 
ruaber of write operatiors to the audit file. If this is true» 
the smount of time spent at 2 syncpoint operation waiting for ¢ 
partiaily-fitled audit buffer to be written is insignificant. If 
syncpoint cperations occtr rather frequently» or the great 
majority of the update orerations being performed require very 
littte audit spaces then it is possibte for syncpoint I/6G 
eperations to btecome a terge enough fraction of the total write 
cperations te the aucitt file that throughput is noticeably 
effected by the time requirec for those 1/0 operations. This 
cegrédation of systen performance can be corrected by increasing 
the number of transacticr operations per syncpoint operation. If 
the Cata Base Adwinisttrator (DBA) has reasons for maintaining 2a 
relatively teow settirg fer the number of transacticn operations 
cer syncpointr then the size of the audit blocks shoutd not 
exceed the default settirg of 1800 sytes. This is especiattly 
true if the upcate progrzms use Cata Comm» since response time is 
so critical in an onwline environment. If syncpcint operations 
eccur infrequentiy and tte update operations being performed 
require very Littte zudit space» then it is possitie in tatch 
environments to significently increase thrcughput by doubling cr 


even tripting the aucit flock size. 
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A third gwajor effect of zeudit block size is on memory 
utilizatione Each time en audit operation occurs» the DMSIT 
System increments an audit serial number» which is stored within 
the globals for the cata base.» There is another field within the 
globais» catiec the unreleased audit serial numbers each time an 
gucit buffer is sritten» this field is updéeted to reflect the 
encing audit seriat rumber for that buffer. Acditicnatlys there 
is ar audit serial namber associateu with each OMSII deta buffer 
which is set to the current audit seriat numter uhenever a buffer 
is updated. By compésrine the audit serial number of the cata 
tuffer with the unreleased audit serial number» the CMSTI system 
can insure that no update cperations are physicaily written to 
the cata base untit the gudit recoras corresponding to those 
upcate operations have been written to the audit trails hence, 
if a fatlure occurs» no fortion cf the data kase is newer than 


the audit trait» which weutd render the data base trrecoveratie. 


As the size cf the audit buffers increases» the frequency with 
which those buffers gre written out decreasese S8ecause of the 
unreleased audit seriat rumber mechanisms» increasing the tenatt 
cf the aucit buffer z~lso increases the tenaoth of time which a 
cata buffer must remzin in memory» thereby requiring more memory 
te process the data tasee Therefore» the DBA should be zware 
thet aithough targer aucit butters can improve throughput ty 
girisizing the arount of time spent wattirg for audit I/C 
operations» there is aise a chance that such a gain can te more 
then offset by memory thrashing» #t@ecause of this» extresely 


farge auacit buffers (larcer than 354074000 bytes) should te 
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avciced on att but tte tzergest systems» and even on these large 
systems» tf a@ high degree of memcry utilization atready exists» 


very targe audit block sizes should be avoided. 


Logicat Transactions 


The concept of a logical transaction is very important in the 
cocing of application pregramse The begqinttransaction and 
enc@transaction cperstiors should occur immeciately tefore and 
efter» respectively» every update operation to a date tase which 
is the result cf a ccmmor input» rather than every singte upcate 
cperations. Each tegin=transaction and end transaction operaticn 
eiso causes a stere cperztion to the restart data set Cassuminge 
thet the ALDIT optior is specified on one or the other of the 
teginstransaction or enac*transaction operation).- Since each 
store operation iS atdited»s the grouping of ltogicaily related 
upcate operations into a@ single transaction can greatly reduce 
the totat auciting overhead necessary» in terms of both time and 
aucqit file space. <Acditionattly» the use cf togical transections 
can simplify the procrarring coding effort for the foltowing 


reasons. 


1. The amount of cocirg needed to perform arestart is 
tinitizedc»s since tte DBA dees not need to te concerned with 
the cossibitity of partiatly comptete togicalt transactions 


and the necessity to back thea oute 
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a At the end transaction operations the DMSII system performs 
an iapdiicit free oreration on ail records currently ftocked 
by a procrame If @ pregram perfor@s severat 
beginstransaction end enadwtransaction operations fer a 
Single irput» it i: possible that records which were 
mocified at the becinning of the process can have been 
freece The prcgranmer must then retock any record tefore 
attearptirg to upcate it» or possibly receive a NCTLOCCKEC 


exceptior cn the store operation. 


Firatly» a program stoulc use as tittle time as possible in 
transaction state» especiatly in a multi-programming environment. 
This tenas te wirnimize tte probability of several progragrs being 
suspendec at the beginstransaction operation because a syncpoint 
opergztion is due white cre prograa is performing an excessively 
long transésction.e. Tc this end» programs in transaction state 
should da nothing thet ccudd result in tengthy delays» such as 
cpening of closing a file or waiting to receive input from the 
CODY or remcte terminat. Aidso» a program shoulo do as much as 
possible of the processirg relative to a transaction before 
entering transaction state» inctuding as many of the nonmupdate 


CMS functicns (Cfind» tock» and create). 
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Syncpoints and Contrctpoints 


The number of transactiors per syncpoint and syncpoints per 
controipcint affects the system throughput while the data base is 
active anc aise affects the amount of tise necessary to perform a 
recovery ogeraticn. For purposes ot processing a data base» the 
greatest throughput can te achieved if syncpoint and controlpoint 
cperztions occur as infrequentiy as possibles thereby minimizing 
the gmount of time progrems might be suspended at a 
keginstransaction operation. If syncpoint operations occur toc 
frequentiys much time car be spent waiting for partialiy-fillec 
aucit buffers to be srittene By reaucing the amount of time 
tetween cortroipcint operations» the probability that an updated 
cata buffer can remain if mencry for two controlpoint cperations 
is much greater» resultirg in many more 1/0 operations occurring 
et a contretpoint operation. The optimum setting for syncpoints 
cer controtpoint resuits in updated NAHO fields being the anty 
items written cut at a crntrotpoint operation.» When receveringe 
the opposite is true. Mrre frequent syncpoint operaticns 
minimize the aaount cf time spent backing transactions out» for 
toth prograa abort ard clear-start recovery.» Sisitarty» frequent 
controtpoirt operations reduce the amount of time consumed by the 
clear“start recovery operation to reapply the changes between the 
last syrcpcint recorc anc the two prior controlpcint records. 
Adccittoratty» frequert syncpoint operations can dramaticatty 
recuce the amount of time recuired to restart a program» since a 
shorter period of tige between syncpoint records means that there 


ere fewer lost transacticns shich need to be rementerecd. 
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khen settirg the syncpoirt and controtpoint parameters» the total 
volume of update activity cccurring in any period of time must be 
taken into corsiceration. Fer tow volumes of updates the 
settings cén be relatively smatt. As the otuge increzses» these 
settings might be increated such that a syncpoint cperation 
represents a censtant percentage of the work toad for 4 batch job 
or a constant response time ét remote termingls in a déta 
communications envircngert. It is possibles through the SM input 
messages fer the operator to change the settings for syncpoint 
enc controtpcint operaticns as jobs change or work Loads 
increase. It is reccmmerded that several settings of these 
parameters be tried in order to determine the best settings for 


any carticeitlar work loads 
NOTE 


The subsection entitted Backea Out Transactions 
further ciscusses the settings for transactions per 
syrecoint in relation to minimizing the aacunt of 
data which the user can affora to tose in the event 


of a recoverye 
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RESTART PROCEDURES 


Cnce an application program determines that a recovery operaticn 


has occurreds the precedtres to restart itsetf are a function cf 


not 


just that program tut of the entire system environment in 


which the cata base ~end frogram are being rune Some of the most 


important facters to be considered are: 


1. 


Is it a batch job? Ooes the program process an externa’ 
cards cisk» or tape file» cr does it update the data base 
Without externet octta? Is the program driven ty input from 


a cata cemmunicaticn terminal? 


Do several programs update the data base concurrently» or 
is only cne pregrays which updates the data base ailowec to 
execute at any one time? If only one update program is 
alfowec to execute at any cone times then reprocessing any 
trarsactions which were backea out by recovery should 
produce resutts which are identicat to those ottained when 
these transactions were originatty processed.» However» 
when several crogrzms update the data tase concurrently» 
the cperctov must take steps to insure that the upncate 
records to be rerur are rementered in exactly the same 
orcer as origirally done» thus insuring reproducibility of 
results. fFefer to the subsection entitted Progreéem 


Synchronizatior for additicnal information. 
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J% In the case of dat@ cosmunication application trograms» how 
is the network implemented? is there a singte program 
handiing all remote transactions or are there severat 
programs? If severai programs» do they have dedicated 
terminals cr is there a Message Control System (mC5) 
runfing to hancle “station assignment? If there is an *CS» 
1s it participztine or nonsparticipating? Both types cof 
MCS perform such finctions as remote file cpen and close 
operations» as well as station assianments to 2 remote 
file. <A participating MCS aiso processes every message 
which passes ttrouch the data communication networks white 
a non-partictostine MCS only processes special control 
messages which eitter the station operator or cata 
communication grogram can specify by means of & signal 


character at the beginning of the message. 


4 In ait fceras of recovery operations» every change made ta 
the cata base efter the last syncpoint record is backed 
out. fhe numter of up¢ate records which are actuatty 
backed ott can be sinimizeds howevers the cost of reducing 
the éwcunt of fost data incluaes accitional overteac while 
performing the updzete operations as well as donger periocs 
of time reaquired te actuatty recover the data tase once @ 
failure cccurs. Therefore» the tradeoff betweer the tise 
required to restart the data Gase and the reprocessing of 
transacations shict were backed out by the recovery 


operétion #ust be considered. 
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These factors must be taken into consideration when the cata tase 
is being cesignec anc when the apptication programs ire teing 
writtens especially vhen determining such things as nugber of 
transactions per Syncpoirt operations the nusgber of syncpoint 
operations per contrctpoint operations and tte duration caf 


transactionse 


Some suggestions for restart procedures» based upon various 
generalizec system ervir«nmentsSs are outlined in the remainder of 
this secticn. <Ailtho.rgh the routines described below can be used 
28 a Starting points and ther modified to fit the specific neecs 
cf an instaitlations the intent of these paragraphs is not to 
specify rigic wethocs of impiementing audit and recovery 
rrccedures. Rather» there suggestions shoulo serve «5 gquidelires 
in icentifying some cf tte factors which must be taken irto 


account when designirg ar application. 


Basic Procedures 


There are a fen restart rrocedures which apply to ait 
environments. At feast cne set» orgered or retrievaise should te 
geclered for the restart sete For iatch proocrams» the key field 
for this index might typicadly be the Program-Id.- For data 
communication croaqrags» the key might identify the station 


respcnsitte for the input. 
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Since a store cperation is performea on the restart data set at 
either the begin-trarsaction or endttransaction operctions the 
program should update adi of the retevant fields in its restart 
record immeditatety before executing that operation. There should 
be sufficient cata storec within the restart record to enable <z 


program to restart itseli in each of the foltowing areas: 


Internai Procedures 


Items which are required to maintain consistency and 
recroducibility cf results» such as control totals or preprinted 
form numbers for checks cr invoicese must be accessibie through 


the restart record. 


Externai Procedures Related to the DMSII Systea 


The progras must be ebile to restore any critical recore or path 
pointers tc their state zt the point of the recovery. This is 
ustaily more iapoertart fer tatch programs than data cosemtnication 
eregrams since SuccesSiveé data communication transéctions are 
typicadly unrelated» whereas batch programs can process 


secuentiailty through an entire structure. 
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Externai Procedures not Related to the OMSTI Systea 


Input ane output files ard non-DMSId managed files such as 
CO#dolL74 ISAM fites mast te present so that they can te 


repositioned. 


General Procedures 


Interaction among the ar€as previousiy described must é@tso be 
taken into consideratione For example» it may be necessary to 
reprecess the payroit for severat employees» repeating the updéte 
operations tc att of the relevant data sets within the data hbase 
anc possibly creatine or adding to other tape or disk files which 
are used by ancther zpplifcation programs towevers if paychecks 
were physicatty created trior to the failures then the program» 
white in restart mode» must either not produce any new checks Cif 
previousty generated] or automaticadly voic any previously 
generated checks and generate new checks to reptace them. The 
restart procedures fer stch an application program must attosn for 
the entry cf the tast form number physicatly assigned. By 
comparing the numbers being assigned to the tast number actuatly 
issued prior to the failtre» the applicaticn program determines 


when to start issuinc new checks. 


NOTE 
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This example assumes a Stand-alone mix. In designing 
the croecedures reaqeired to restart such a prograa 

when several proqrzems are updating the data baser the 
interaction among #ii programs must be considered in 


orcer to guarartee reproducibility of results. 


Restart Record Hanctine 


Immeciately after openine the data vase» & program shoulc tocate 
anc dock its restart recerd. If the operation is successful» the 
pregram shculd examire that record to determine if a recovery [as 
cccurreds anc if so» the restart procedures should be executed. 
If the tock cperatior is unsuccessful» a create or recreate 
operation gust be perforved at this time to establish a locked 
record for this program tend prevent the program from getting a 
ACTLCECKED exception shen it atterpts its first begqintransaction 


or €nd transaction with zcudit operation. 


Just before ctosing the cata tases the fotlowing CCBCL or COBCLI?4 
coce can be performec to delete the restart record of 2 prograg. 


(<exc> refers to excepticnmhandting code): 


HBEGIAT TRANSACTION NG*AUDIT <restart-data-set=name> <exc>. 
LELETE <restart-cata*set"=name> <exc>-». 


ENO*TRANSACTION AG@ALDIT <restart-data"set~name> SYNC <exc>. 
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Fy deleting its restart record» the program insures that its 
restart prccedures need to be executed after data base open oanty 
when the initist tock operation on the restart set is successful. 
Kote that AUCIT is stppressed on both begin transaction and 
enc*transaction operéetiors since there is no need to restart ttis 
cperation.» Atso» the specification of SYNC insures thets if 
ancther programs aborts after this end "transaction operéticn tut 
tefore this program can close the data base» the ABORT exception 


et the close can be ignored. 


Another wethod which can be used» rather than the deleticn of the 
restart record» is tc maintain a batch number within the restart 
record. The current batch number is given to the programs eitter 
from the COT or an exsterral file» and compared to the number 
Within the restart recorc. If the two numbers matches this run is 
a contintatiaon of an interrupted batch» and the program must 
cerfcrm its restart routines. If the two numbers do not métch» 


this is a new batches and no restart is necessary. 
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Batch Prograas 


Batch prcgrams are mech €asier to restart than data 
communications programs since they usually deat with one or no 
crimary input source» are it is relatively simple to mairtain 
information concernirg tte position of that input file as well as 
any output or secondéery input files. Also» there is typically 
very tittle interaction zemorg batch programs which might 
complicate the restart. <Acditionaliy» because the input data 
which arives a batch procram is reacily retrievable» as opposec 
to that of a data coamunication program» the importance of tost 
cata is minimizec Since the tost transactions can be easily 


regener atece 


A chysical count of the rumber of input records processed can te 
used to repositicn an intut files and upon restarting» that many 
records can te passec over. For ordered OMSIT structures or any 
cther nonvwC(MSll ordered files» a key field accomplishes 
repositioning. However» output files other than disk cannot tbe 
physicality reoncsitiorea. Therefores multicie ocutput cerd or tape 
files must be wergec» ane tine printer files» especiacity in the 


case of preprinted forms» carn require operator intervertione 


Cue to the relative ease of recapturing dost transactions tin a 
tatch environment» it is possibile tu reduce the amount of 
cverhead irnvetlvec in auditing a batch program by grouping many 
fogicai transactions inte a singte physicat transaction. Since 
the store operétion cn tte restart cata set at either a 


tegin transaction or enc"transaction is audited» and the audit of 
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a store operation on any data set consists of a tefore image and 
en after image of thzt deta set» then a program which grcups 
several legical transactions into a singte ptysicat transaction 
can reduce the awount of time required to aucit the changes to 
the cata tase as well as minimize the physical tength of the 
aucit trail. If this is done and a failure occurs» the number of 
records which sust be rerrocessed can be #wuch higher» but the 


savings in overaifi rin time usuatly more ttan offsets this. 


If the batch jcb is running with several other programs which 
upcate the data bases the Length of a physical transaction shouted 
te shorter than that for a program running alone. This prevents 
the possibility cf thre other programs waitine for 2 syncpoint 
operetion which cannet occur untit this program has completec its 
current transactione If the transaction is too tong» the cverail 
System deagradcaticn czncels out any gain to a singte program. If 
the cther progrags irctuce data communication applications» it is 
test that the batch crograms perform a single physical 
transaction for each togical transaction.s« If a batch pregram 
runs in several cifferent environments» the number of logical 


transactions per physical transaction should be flexibtle. 


The initial toad of ¢ data base is a@ speciat case of a 
stenctatone tatch jot. It is not necessary to audit the toad of 
aocata set containing relatively few recorcs. This is true in 
the case of any cata set which is swait enouch that the Length of 
time necessary to rerun the entire dunaudited) toad in the evert 


ef a faiture is so skort as to offset the overhead required in 
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crcer to sake the precess restartabile. In such a case» audit end 
recovery shoulc not te irctuded in the original descripticn of 
the cata basee After the load has completed» an UFDATE CrS/TASCL 


compile can be run te ade audit and recovery to the data tase. 


If the load of a date base is tong enough to warrant it teing 
eucited» it is stroncly recoamended that 2a taroaqe nuaber cf 
logical transactions be «troupec inte single physical 
transactionse- The number of togicad transactions can te as hich 
as 1% of the totad nember of records to be toaded» up to a 
waxiwum of about 500 togicat transactions per physical 


transaction. 


Cata Cossunications Frogranas 


Eecause cf the complexity of data coamunications environgentses 
the procedures requirea to restart UMSII procrams using remote 
files are such mcre complicated than the methods batch programs 
car use to repositior inrut files to the point of the restart. 
The factors shich recuire the more complex restart procedures 


include: 


1. A progranr can te receiving inputs from several independent 
terminalis and aust therefore be able to restart each of 
these terminatse ccmmunicating to thew their individual 


restart pointse 
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Ze A rencte file ts a conceptuad entity. The input data to a 
program exists only in the data communication tuffers anc 
only for the dtration of the transaction. There is no 


Simple way to repotition such a file. 


36 There are sany prottems which arise when several programs 
are updating a cate base cencurrently. For exemptesr the 
timing in whick the criginal transactions were generated 
can affect eact cotter» and the same sequence of 
transactions mist therefore be duplicated by the restart 
precedures. Also» if an MCS is present to hancie station 
assignment» the pregrams must maintain a record of which 
Stations they vere dealing with at the point of the 


faiture. 


Restarting Remote Stations 


Rather than the record number or symbotic key which tatch 
programs use tc restzrt themselves» data coma#unicaticn programs 
sust have a methcd cf conmunicating to the remote operator the 
dast complete transactior. This is normaity accomplishec Cy 
storing in the restart record either the last fult screen input 
or some part of that input which contains sufficient infcrmation 
to communicate the restart pcint to the operator. The operator 
must then retenter ary transactions which can have been tost 


curing the reccverye 
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There are twe approaches that data communications programs can 


use when auditing: 


Audit by Progras 


A single restart rececro exists for each program» as is done in a 
batch environment. If a program is processing data from several 
stztions»s the restart record should inctuce an array whick 
contains an entry for each of those stations. The program must 
use the REPOTE.KEY file ettribute in order to determine the 
source of each input. The retative station number czn then Ce 


used as a subscript into the array. 


Audit by Station 


A restart record exists for each station in the network. The 
Stetion nurber» or the remote operator*®s name or tog-on codes can 
te used as a key field fer this approach. Also» the DBA can 
either define a special set for the restart data set to maintain 
the restart records ty stations or the same set used by batch 
programs can be used bty cata communication programs. In the 
tatter cases batch procrems can piace their Program~Id ir the key 
fielc» white Data Conm programs can place the station number in 


the key fiela. 
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Generati Restarting of Data Communication Programs 


When auditing by stations there is additional overhead in that 
the program must pertorm a tock operation on the restart data set 
tefore performing a tegirmtransaction operation» if the trograng 
detects that the current input is not from the same station as 
the fast input. If en MOS is present» whether participating or 
non-participatings and it atiows stations to be detached from cane 
remote file anc reattached to ancther filer» then it can atso be 
recessary for a program to perform a free operation on the 
restart record after eact end-transaction operation to prevent 
the rext program which accesses that staticn from receiving @ 


CEADLOCK exception.~ in this case» the tock operation at the 


teginstransaction operation tCecomes unconditional. 
NOTE 


The unconditioral dree and tock operations can te 
avoiced if the MCS contains a mechanisas for informing 
prcorams when stations are being detached» possitiy 
by passing some form of log-otf message to the 
program. {ff this is done» a station being detached 
needs to be freec cniy if it was also the tast 
station to senc a transaction» and the tock operation 


is necessary a8 in the case of a nen*MCS environgent. 
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Auciting by program is stfficient it a program is receiving data 
trom very few statiors. However» when many stations are cn the 
fines the size of the retetart recora can become prohibitively 
large if this methoc is tsede In most wuitistation environments» 


therefore» auditing ty station is usuatty more effective. 


kKhen a batch program is first executed» it should attegpt to find 
anc tock its restart recerd. If that restart record exists» the 
frogram takes whatever action is necessary te restart itself» as 
incicatec by the contents of the restart recorde when a data 
communication prograwr is first executed» it shoutd fottow the 
Sage general proceacures. However» white operztor interaction 
tends to be wirimat then batch programs are teing restarted anc 
is neormaily for the furptse cf restoring external mecié» data 
communication cercqrags west inform the remote operator of the 
last transacticn processed» and the operator must then rerenter 
eny transactions tost. fdditionally» whether the data 
communication pregran is auditing by program or by stations it 
wust perfora this precest for every station which it was 


~ccessing at the time of the fatture. 


Whether auditing by grogram cr by stations there shoutd be some 
sethod of notifying @ pregram that one of its stations has gone 
cffiines If an €CS is ranning»y the MCS can perform this function 
through @ special input wessagee. Without an MCS» it can te 
recessary to enter stich =¢ message through the ODT cr another 
station on the lines If a station goes offline» the restart 


records whether for the ¢rogram or the particular station» must 
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te updated to refiect the loss of a station. In the case of an 
zbrormai tess cf stations the restart reccrd shoutc indicete that 
the station needs to be restarted when the station is trought 
back online» In the case of a station togqging off» the restart 
record shoutc indicate ttat the station is inactive. This 
includes the case of an *CS detaching a station from one progrem 
ena reassigning that station to another programe. Faiture to merk 
such a station as tnzective when auditing by program couia resuit 
in a single station receiving restart messages from several 
programs rather than just the last program to which it was 


attached. 


If auditing by programs the array of station information shouic 
incilude a flag indicéetine that a station 18 actives or that the 
station has abnormaity gene offline» When a program first 
focifies its restart recerd immediatety after opening the data 
tases it must restart each station tor which there is vatid 
restart information zs irdicated by this flac. As in the case of 
é batch prcgraa» the restart record can be deleted just tefore 
the progranr ctoses the data base untess the program recagnizes 


that it hac abrormattiy test cne or more stations. 


hhen auditing by stations each time a procrams encounters a new 
stations it should attew#rt to modify the restart recora for that 
station. If the fine ance tock operations are successfut» the 
restart record shoutc be examined to determine if the station 
reeds to be restartec. If the find and tock operations are 


unsuccessful» a create oferation must be performed or the restart 
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cata set tefore the program ettempts to execute a 
begin-transaction operation» The restart record shoutc inctude a 
fietc to indicete which ftrogram was accessine the statione There 


is no need tc celete restart records when auditing by station. 


Backed Out Yransactions 


As stated eartier in thit sections ail forms of recovery result 
in some transactions beirg backed out. This loss of deta is 
usually not very critical in a batch environsrents since the ingcut 
file is normally studi available. however» since the tost input 
is not reacily avaiteble in a remote environments the 
airiaizaticn of tcst trarsactions becomes very important. It is 
posstbde tc accoaplish this» at the expense of some throughputs 
by acjustinrg the frecuency with which syncpoint overations are 


performed. 


Frequency of Syncpcints 


It shoutd be apparent thet the minimum data toss can be achieved 
ty performing a syncfpoint operation after every transaction. tut 
cue to the adrount of overheac this operation can requires in 
accition to the amourt of time programs would spend waiting for 
syncpoint cperations to completers this setting it usuattly not 
feasible. However» it stould be possible to determines if not a 
precise setting for trantactions per syncpoint operations at 
least a range of settings which take into account all of the 


factors mentitonec abcvee 
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In order tc prevent crograms from continuatl y waiting for a 
Syrcrotint cperation to cemplete» the minimun setting for 
transactions per syncpoirt operation should te the number of 
RErograms cencurrently upctcating the data base. Since the 
traéansactior count is incremented at the ena~transaction operation 
rather than the begir-trznsaction operations it is pessibie for 
the rumber of prograas ir transaction state to be larger than the 
setting for transactions per syncpoint operation.j If this 
setting is less than the number of programs updating the dzta 
tases it is very tikely that one or more procrams are in 
transaction state every time that a syncpoint operation is 
schecutecs thereby celaying that syncpoint operation until those 
rroaqrams have corpletec their current transactionse Hence the 


recogmencec minimum setting. 


{f the number cf program: which are updating the data tase 
chéenges several times each day» the number of transactions per 
Syncpoint operation can te set to the average nuaber of prograns 
active at any cne tise. Alternativeltyr if there are a series cf 
ciscrete job mixes» the £4 input message can be used to adjust 


the setting between fixes. 


The maximum setting tor transactions per syncpotnt operation 
should reflect the greatest amount of data that the user can 
efford to loser whickt is typicadly one transéction per station. 
The setting of transecticns per syncpoint operation should 
therefore te set to insure that the maximum rumber of 


transactions between tro syncpotnt operations is no greater than 


1152444 4-47 01/19/84 


the number of active terninats. The Largest number of 


transactions which cen occur between two syncpoint operations is 


(transacticns per syrcpoint # update programs running - 1) 
The rumber generated by the above formula would result if every 
update program was in tr@nsaction state» and the current 
transactior count was one tess than transactions per syncpoint 
operation. When the next end-transaction operation is performed» 
a@osyncpoint operation is schedutede but it cannot oecur until att 
of the rewmdzining procramt are out of transection state Conce the 
syncpoint operation is seheduleds no more programs can erter 


transaction state untit the syncpoint operation is completed). 


Fetween these two extremes» the determining factor for the acttrial 
setting cf transacticns fer syncpoint operation should be tasec 
cn the vclume cf wpdete etctivity occurrinsc. In a townmvyotume 
environ#ents the setting can be at the tow end of the rarge for 


two reasons: 


1. Given infrecuert transactions» the tikelihcodc cf programs 


waiting for a syncroint operation is minimal. 


rae The toner setting can reduce the possititity of aucit 
records regaining in memory for tong periods of time» 
whiche in the event of a failures» coulc cause transactions 
to be backed ott even though they had cecurred quite a 


while before the fzilure. 
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As the volume cf activity increases» the setting for syncpcint 
cperations shouilc ateto ircrease since the overhead involved in 
performing frecuent syncroint operations can quickly teccme 
prohibitive. khoxeyvers» regardless of the egmount of activity 
eccurring»s the upper bourd fer transactions per syncpoint 
cperstior sheculd onty tbe usec if the numter of staticns is 
relatively swait Capgroximatety 25 or tess)» and the transactions 
are eventy distributed asong atl of the stationse If this is not 
the cases» the tdikelitood of aultiple transactions from one 


station kefore a Syncpoirt operation increases dramatically. 


As statec abover it is tte station operator’s responsititity» 
once the recovery operation is compaetes» to reenter any lost 
transactions. Aithourgh it is possicte to sicnificantly recuce 
the amount of tost dzta through the setting of SYNCPCINTs» tength 
cf transactions» and ever audit buffer size» there czn be some 
instances in which it is necessary to completely eliminate any 
cata losse This can be éeccomplishea within OMSII ty requesting a 
syncpoint at the end trarsaction operation» or independertiy of 
the GMSTI system by saintaining a separate audit trail of ait 
refote input. If a separate data coamunicsation aucit is used» 
anc @ program recognizes that a recovery operation has occurrec» 
it can use the data sithin the restart record to identify its 
restart point. fhe frogram can then use the data coemunication 
audit trait to auteomaticztiy reprocess any transactions which 
cccurred tetween that restart point and the system failure. 
Therefore» ty combining the two types of atdit traits» a user can 


acccaptlish a tctal recovery operation in @ much shorter period of 
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tiee thar would be pessitie using either cf the two foras of 
aucit by itself. The user must be aware» towevers of the 
increase in system overhead either uf these sethods entaiis. The 
encetransaction cperéetiors with syncpoint should be used 
sparingly» only for very critical transactions. Simitarty» data 
co#munication aucit shoutd not be used on smaiter systems nwhict 
cannot afforo the extra cverhead undess it is absolutely 
necessary to remeve the responsibility fer data reentry from the 


stetion operator. 


ACCITIGNAL MULTIFPROGRA® MINE CONSIDERATIONS 


fhe follawing paragraphs describe the use of an Message Controti 


System (MCS) ano procras synchronization for DMSII programs. 


Use af an Message Cortrol System (MCS) 


The wost important factor to consider when muttiplte data 
coamunicatior prcgrags are updating a data bese is the presence 
of an MCS. If each g¢rogqram is independent of the others» and 
stations ere dedicated te a program as torg a5 that program is 
runningse then the prccedwres required are effectively the same as 
those outtined above vregerdtiess of the number of programs running 
concurrentiy. If» hewevers an MCS is runnine to handle station 
essignments» and the #CS aitions attachment and detachmert white a 
gercgram is rurnnings cr the program cannot determine from ane 
execution to the next which stations are assigned to it» then the 


restart crcecedures become more compiicatec. 
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When a neteork is brceught up» any active stations for which 
restart records exist shculd be restarted immediately since a 
stétion can be assigned to a program other than the one which 
created its restart record. Speciad restart procecures shoutd be 
written to acccmptlish this. These procedtres can te part of the 
PCS if it is written in (OBOL. If the MCS is not written in 
CCEOL» the procecures car either be embedded within one cf the 
application programs or sithin a specially written restart 
pregram. In either cf tte latter two cases» the MCS must execute 
the program containing tte restart routines tefore executing ary 
cther programs. it is tte restart program's function to examine 
att restart records and rotify the programs which originatty 
créeated these records thzt a recovery has cccurred. These 


proorams can then perfora their specific restart routines. 


It is also the function cf the restart program to initiatty 
create each restart record of the station if no record exists 
when a station cemes on tine. When a station becomes inactives 
or the network is shut dewn» the restart program can either 
celete the appropriate restart records or update those records to 
incicate that the stétiors are inactivee Stztions which are 
inactive when the network is brought up shouid be ignorea ty the 
restart program until they are made ready» at which tige the MCS 
can notify the restart program of the event. When using this 
approachs the restart records must include beth the station 
number and the Progrzmele. It can Ge necessery in this tinastance 


to dectare two paths Inte the restart data set: one by 
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Frograg-Id for batch procrass and one by station for data 


co#gmunicatior crcararse 


Prograa Synchronization 


If a recovery has occurreds and it is necessary to rerun 
transactions which were tacked out» it can be very critical thet 
the teansactions are re~mentered in exactly the same orcer itn 
which they were criginatly created. This is especially true when 
many prograas are upcatirg a common data set» or several copies 
cf the sage program ere runnings since it is very likely in such 
circumstances that a trarsaction against 2 given data set can 
have an effect on sutseqtent transactions against the same data 
sete if these transecticns are rerun in a different order» the 
net resuits can be stebstentiattly ditferent. For exarples» an 
invertory item might have been out of stock when an order was 
criginaltdy entered» but the same item could te in stock on the 
rerun if the transactions were entered in a cifferent sequence. 
In order to insure that the updates are rerun in the same order» 
€ither time stemps cr secuentiat transaction numbers should be 
essigqned to €ach trarsaction. These time stamps can be 
maintained in a cata cornunication audit traits if one exists. 

If no datz2@ comaunication audit traid4 is being used» the time 
stemp can bke returnec to the station operéetor part of the data 
valtcaticr process. In either event» the following procedure can 


te used: 
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1. Ald records which zre to be updated must be modified prior 


to the assignawent cf the time staa@p cr transaction number. 


Ze Ali cf the actrat updates must be performed after the tine 


stamp «5S genereted. 


This procedure insures ttat when reprocessing transactions after 
a@orecoverys if the user trogragss include the origtnat time stamp 
With each transactior Ceither automaticaliy provided from the 
cata comatnication ardit or entered by the station operator as 
part of the restart procedure)» then the restart orogram can 
require that ali updztes Crather then just the input for those 
trarsactions) are perforsed in exactiy the same orcer as they 
were originaliy cones thes guaranteeing reproducibility cf 


results. 
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SECTION 5 


DSTA BASE SECURITY 


The Cata Base Adwinistrator (DBA) can control security of @¢ data 
base at three leveis: item Level» record tevel» and structure 
devel. Item tevel security controls which items within a record 
é prograge can access or sodify and can he achieved using the 
KICDEN and REACOANLY cata item options. Record tevel security 
cortrots which recorcs within a data set are visible to the user 
snc which records» if éeny» the program can aiter. Reccrd ievel 
security can be achieved by using the SELECT and WERIFY 
conditions. Structure level security controls the structures ¢ 
user can invoke. In short» remaps provide item and recora tevet 
securitys white togicai cata bases provide structure level 


securitye 


There are several ways te enforce security on a data base» 
cerperding cn the tevetl of security aesired. Through the use of 
the SECURTIYTYPE and SECURITYUSE fide attributes» total access to 
the CMSIY cata base can te restricted.» Usince REMAPS» LOGICAL 
CATABASESs» and SECURITYGUARD files timited portions of the data 


tase are made accessible. 
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Security Features 


The fotlewing cescrites the types of security available with the 


cpéerating system CMCFIIT) and the OMSIL system. 


Cperating Systea Security (Non~OMSIE Access) 


This capability is availeble through the use of the TITLE» 


SECUFITYTYFE» anc SECURITYUSE attritutes. 


Each structure Ccata sets set» and audit trail) gay te secured Ly 
the use cf the terms mentioned previousty~. These terms» being 
part of the physical specifications are required for each 


physicat structure ttat nust be secured. 


The cicticnary and tibrary filess atter being created by the 
CMS/CASCL compiler cen also be protected from non~privitecged 


users by use of the ®H irput message. 


Ey using TITLE» it is possible to give any structure (data set» 
sets» an aucit tratti) a miutti-filetid of usercode rather than a 
cata base rare. The usercode must be enctosed in parentheses 


which must themsetves te enclosed in quotation marks. 
Examples 


TITLE = "“CUSCOLDEI"SA 
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Fefer to Ccmpiting The Ceta Base in this section for restrictions 


on dzgta Kase compitation under the security system. 


Ald fites» with or without usercodes» can te protected using the 


SECURTTYTYFE’ and SECLRITIUSE options. 


SECURITYTYPE 


SECURITYTYFE has two settings: PRIwATE and PUBLIC. 


FRIVATE 

The PRIVATE option tpecifies that onty - priviteged user» or 
@ user whese usercote matches the usercode of the file>» if 
any» is adiloweo to ¢eccess this file. Therefore», to copy» 
List» or remove this file (COPY¥Y» DMPALL»s or REMCVE) must te 
run under a priwsiteced usercode or the usercode of the tile. 
It is not possitkte to access this type of file even from the 
OCT except by means of a priviieged usercode or a usercode 
which matches the file. This inability to access the fite 


protects the file from accidental remevai. 


PUELIC 
Tne PUBLIC copticn srecifies that access to the file is 


unrestrictecs cdcepencingag on the setting of SECURITYUSE. 
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SECURITYUSE 


SECURITYUSE has three settings: I0» INex and OUT. 


10 


The 10 option enables both reading from anc writing to the file 


ty any user. 


iN 


The IN option attlows reaccontly access to the file. 


cul 


The CUT option altous write~onty access to the file. This 


setting has no significarce for data base files. 


whenever the SECURITYUSE and SECURITIYTYPE attributes are not 
specifiecs security cefartits to the security attributes of the 
tirst matching userccde in the SYSTLM/USERCODE file.» For fides 
without usercodce TITLES» the default security attributes are 


PUELIC/IC. 


Exampies 


A CATA SET C 


—E CATA SET C 


we 


S SET GF 8@ 
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PRIVATE). 
PUBLIC, SECURITYUSE 
PUBLIC» SECURIYYUSE 


A CSECURTITYTYPE 
—E (CSECURTTYIYPE 
S (CSECURTTYTYPE 


IN)> 
IN); 


Hou ut 
no il 


CNSIL ACCESS 


Secured access to cata beses may be defined at two tevels» as 


fotiows: 
1. Protection at the ttructure and item tevet. 
Ze Protection at the cata base Cand logicai data tase) level. 


Structure and Iten Protection with iogicai Data Bases and Remaps 


it is possible tc intibit access to any items» record» or data set 
ty the use cf rewaps and togical data bases. Rewapping prevides 
the facilities of hicing an item» making en item reacvronty» anc 
rerasing ar item. It al*o attows records to be hidden by the use 
cf SELECT. If a precram is using a remap of a data set ano that 
remap has a SELECT ciause attached to its» then the DMSII systea 
cecices whether that procram may access a certain record by 


valicating it against the selection criteria. 
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Exéempile: 


PERSONNEL CATA SFT ¢ 


FERS~NG PUMBER (6)s 

FERS“SAL PUMBER (€6ec)> 

FERS-AGE PUMBER (2) 
)> 


PERS“REMAF FEMAPS PERSONNEL € 
FEARS“NCe 
FERS"“SAL READOSLY:; 
SELECT CPERS-£AL < 1000); 
This exaagpie would ailfow a program invoking the PERS“REMAP dete 
set to access cniy PERS-80 and PERS-SAL and to change onty 


FERFS“NC for ald records there PERS“SAL has a vatue tess than 


1000.00. 
To inhibit access to PERS“SAL» the fottowing remap coutd be used: 


PERS“REMAP REMAPS FERSONNEL ¢ 
FER S“NC3s 
FERS*SAL FICTENs 


SELECT CPERS=SAL < 1000 )> 
The HKDDEN keyword afiowt the item to be usec in a SELECT 


stétement white remainine hidden from the program. 


Logical cata bases cén also inhibit access to data sets. 
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Exampies: 


CUSTCMER CATA SET ¢ 
3 
FCUSTCMER REMAFS CUSTOMER ¢ 


3 
FROOUCTS GATA SET ¢ 


INVOICES CATA SET ¢ 
pe 
LDB81 CATABASE (RCUSTOMER»> INVLICES)>s 
The program using the locical data tase LODB1 cannot access the 


FRCCUCTS data set. 


Frotection of Entire Physical and Logicai Data Bases Using 


SECUFITYGUARD Files 


Juctcious use cf remappirg and togical data tases effectively 
inhitits access to sensitive data. However» specificaticn of a 
togicat cata base in CCB{L or RPGII requires the naming of the 
physical cata basee Therefore because the physical data tase 
rape is knowns access to it can be gainede This probtem can be 
solved by the use of SECURITYGUARD tites. A SECURITYGUAFRC file 
way te applied te a flogicat cata base or physicat data base. 
Each date tase may hve z separate SECURITYGUARD file specifiec 
in the OMS/DASCL source. It is necessary to specify the name of 


the SECURTTYGUARTD file fer each data base to be protectec. 
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To apply a SECURITYGLARD file protection to the data tase in the 
previous examples the following statements azy be adaed to the 


CMS/EASOL source: 


Examples: 


LDB1 CSECURITYGUARD 
EXDE (SECURITYCUARL 


LDBIGUAKRD) 
EXDBGUAnD) 


‘es WE 


EXCB is the name of the thysicat data base given in the compile 


statement. 


SECUFITYGUARD Fites 


The SECURITYGUARD files ere data fites containing usercodes 
positionec betreen ceiumrs 1 and 72 and in freeform coding. A 
rercent sign (2) character at any point if a record terminates 


the scan of that recerce 
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i 
I-- DEFAULT = ---2"- NO s--9- 5 =H1 


i-- FO --1 
a { 
I-- FW =< 
Dt a ee ee ee en en enn ne ee eens cece ss se ee ecser=s] 
i 
1 | <n tn en ee ee ne ne en en ence nn- eleaeatetatetetetatater w---] 1 
1 4 ii 
[------ USEFCODf = <usercoue> -=--- NO -"--" 3 s22"1 
i 
I-- RC ="! 
i 
I-- RW --] 


Semantics: 


CEFAULT 
The CEFAULT keyaord specifies the access allowed for 
programs not executing with a usercodes or for programs 


running under a usercode not included in the SECURTTYGUARL 


file. The usercoae’t included in the SECURTITYGUARD file are 


treated as excertiors to the OLFAULT statement. 


<userccce> 


The “usercoce> fielc specifies the name of the usercode te 


be stcred in the SECURITYGUARD file. The OMS/DASOL compiter 


does rot verify that any <usercode> specified in a 
SECURITYGUARD file tis a valid usercodese that is» containec 


in the SYSTEM/USERCCOE file. 
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The “usercoce> can te specifiea with or without enctosing 


parentheses. 


KC 
The NC keyword specifies that the named <usercode> cannot 


access the data base. 


RQ 
The RC keysymbot specifies that the rammed <usercode> can 


open the cata bese in a reacvonty Cinquiry) manner. 


FW 
The FW keysymboi specifies that the neaed <usercoce> can 
open the cata tzse in either a read/write Cupdate) oar 


reacvwoniy Cinquiry) manner. 


Fragmatics: 


lf no SECURITYGUARCD file is specified for 4a data bases the 
cefault access atdowed fer ait users of that data tase is 
FEADSWRITE. This is equivaient to including a SECURITYGUART file 


with onty one entrys CEFAULT = RW. 


If a SECURITYGUARD file is included for a aata base» but no 
CEFAULLT statement is includec in thet file» then DEFAULT = NC is 


eassumede 
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A SECURITYCUART fite showtd be created as a private tide and need 
oniy be avaitabtie curing DMS/DASDL compilation as the infcrmation 
is transferred to the cictionary.» iherefores to make changes to 
this part of security recuires changes not only to the relevant 


SECUFITYGEUARET file bet also a DMS/DASDL SLPDATE compitéetion. 
Example: 


CEFAULT = NQ>o 
LSERCCCE = USER RW» 
LSERCCLE = USER2 RO» 


Coapiling the Cata Bese 
A data base ray be ccempited by two methods as fotlows: 
1. From the GLT> withcut fide security. 


Ze By a prividiegec pregras Ca nonprivileged program cénnot 
create files with 2 multirftilerid other than their onn 


usercode). 


The resudtant litrary files and the dictionary are puttic and 
unsecured (they have no tsercode atiached to them). However» 
they can be protectec with the MH input messagee The data base 
files are either public cr private agepending upon tte status of 


SECUFITYTYFE as mentionet previousty in this section. 
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Cospiling Frograas 


If protection of the library files is not changed with the MH 


input message» no security problems are encounterec while 


conpiting peregrass. The MH input message can be used to make 


litrery files private. 


Examples: 


WH ATE/CSA SEC PFIVATES 


The progras must then be compited under a2 privileged usercode to 


access this library. 


Executing Prograss 


ihe program can be executed if: 


1. 


The cata base tas ro SECURITYGUARD file or the usercode 
uncer which the pregram is executed 153 contained within the 
SECURLTYGUARD fite for the data base invoked (Ctocicat or 


physicat jd» anc 


Access to the cata base is consistent with the setting fcr 
that usercode in tte SECURITYGUARD tite. For example» if 
the entry tn the SECURITYGUARL file is USERCCGDE <usercode> 
= FC» then the procram can open the cata base input only. 


Opering the data bese update would give a security error. 
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CMS/INQUIRY Progran 


The CMS/INQUIRY crogram tas tts own security system offering 
rrcetection in additicn te the SECURATYGUARD file protection. At 
execution times the CMS/EVUILDING program esks if security is 
required. Answering YES causes the OMS/BUILDING program to 
request valid usercoces valid for the DMS/INQUIRY progrem but 
not necesseridy in the CEYSTEMI/USERCODE filed. The data tase 
car then orty be accessec through the DMS/INQUIRY program if the 
CMS/INQUIFY program is executed with a usercode valid for that 
cata base (a usercode given to the EMS/BUILDING prograw anc 


entered in the SECURITYGUARD file). 


Conctusion 


It is possible to intibit any unauthorized user from accessing 
the physical data base» eny togical data base» any dzta set» any 
records» enc any items. This access criteria applies to aii 
programs» whether usermwritten or the ODMS/JINQUIRY program. It is 
aiso possible to inhibit any data base file from being copied» 
listed» or remcved by ary non priviteged user inctudinge a user at 


the CDT. 
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SECTION 6 
DHSJDECOMPILER PROGRAM 


The CMS/CECOMPILER progrzem is a decompiler. [ts function is to 
reconstruct the original DMS/DASDL source of an existing CrSIl 
cata base» based upor the information containec in the dictionéery 
of that cata base» The reconstructed source includes all 
parameter anc option settings nontuefault physical attributes 
for gti structures» end zeny corments encicsed within quotation 
marks in the original sowrce. Comments denotea by the percent 
sign (%) character are net includeds nor are the original dollar 


(3) options to the BeS/sDe@SBL compiler. 


Cperating Instructions 
Enter through the Operater Disptay Terminat (ODT): 


Syntaxé 


COMPILE <catawbase-neme> DMS/DECOMPILER werent sete rrer rr) 


[ fee ee ww ew ew ee ee ee = = 2 am ee as aee | 
1 I 


peeen= SYNTAX sree n ste na ee en ee ence en ence eenen- alalatatelatatelatetatetetetateieteted 


j us j i 1 
I i Pers Ton SHITCH 7 = <n> “1 
i-- LIERARY <~1 i oa 1 


~< i ] 
tens 1 Nwm SWITCH 9 = <n> =-4 
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Semantics: 


SYNTAX 
The SYNTAX keywerd tpecifies the generation of 2 source 


Listing only» 


LIBRARY 
LIGRARY or LY specities the generation cf a source tisting 
and 32a copy af the new source file on disk.» The new file is 


tittiec: 


<datasbase-name> sSO0URCE 
SWITCH 
Setting Switch ?#? > C causes DMS/DASDL compiter options to ke 


inciuced tn the new source through the CDT. 


Setting Switch $ = r specifies the nusber of spaces the 
source listing is tc te indented for each nested tevel. If 


Switch 9 = Oe the defautt is five spaces. 
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SECTION 7 


DMS/DASOLANALY PROGRAM 


The CMS/CASOLANALY progrem decodes the contents of the data 
structures within a CMSI] data base dictionary. The types of 


cata structures swhict are analyzed ares 


CMSTI Gichals 
The CeSII giobadi intormation is stored in this structure» 
which contains pointers used by both the cperating system 
CMCPII) and the DMS/DASCL compiter that point to other éreas 
in the cictionary. Data fields used by the DMSII systen in 
the operation of the data base are aiso contained in the 


DMSII giotais. 


CMS/DASCL Globals 
The CMS/DASCL global information is storec in segwert three 
of the cictionary. This inforgation is a snap shot of the 
DMS/CASCL memory fietds at the end of a compiite. The 
DMS/DASODL gtobail intormation include rfointers tea the varicus 
DMS/CASEL tabtes within the dictionary» such as the COL 
table» name table» cath tabte» key table» attritute tables 
and Pclist table anc are used ty the OMS/DASDL coapiter 


during an upcate cospile to retoad these tables intc memory. 
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Aucit File Parameter Block CFPB) 
The audit file caraneter block is a system fite pzrameter 
biock CFPE) that is aiways contatnec in segsgents 1 anc 2 cf 
the dictionary. These gre used by the operating system 
CMCPII)» the OMS/RECOVEROS prograas and the DMS/ALDITANALY 


program tec process the audit file. 


COL Table 
The CCL tabte ccontains information about every item 
described in the DME/DASDL sources including structures» 
data items» and grotp items» tntries within the path» key» 


attribute and titerzet tables refer back to the ODL takte. 


Name Tabde 
The name table contzins every identifier used in the data 
basee Entries sithin the DOL table point into the rare 
tabie. If two cr mere data items have the same identifier » 
the respective COL entries for those iteas point to a ccomaon 


name table entry. 


Fath Tabie 
The path tabie relates the various tebtes relevent to a 


given structure. 
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Key Table 
The key table ccntains information about every cata item 


usec in a KEY declaration within the data base description. 


Attribute Tatte 
The attribute tzble describes every chysicat attribite 


explicitiy set ty tte user within the D¥S/DASDL source. 


Folish Table 
The Pelish table cortains encoded versions of every WHERE» 


VERIFY» and SELECT statement in the OMS/DASDL source. 


OFh Table anc Fite Recerds 
The CFH tabte ard file records descrite ait of the physical 
files in the data bzse. The file records contain the 
avaidiable space infcrmation used by tte operating system 
CMCPII) when allocating records» as well as the version 
Stamps for each file. The OFH tabte is pointed to by the 
DMSII global inforawztions and contains static information 
about eact fiies such as number of areas dectared and 
seqrents per area. Each entry in the DFH tabte points to a 


correspcncing file record. 


Structure Records 
The structure recorcs describe the physical attributes of 
every structure in the data base. Pointed to by the CMSII 
giotals» the structire records are used by the operating 


system (MCPIT) to process the cata tase. 
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Structure Nagwe Yabie 
The structure reme tabte contains the name of every 


structure defined fer the physical data base. 


Invoke Table 
The irvoke tabte cortains one entry for every physicat data 
set or remap which is invoked in any togicai or physical 
data tase. Every otysicat cata set is implicitly invoked in 
the physicat céta bzses ail other invokes» of toth physical 
and togical structures» are explicit ty means of a DATABASE 
Statement in the DMS/DASOL source. There ts onty one entry 
in the invoke tzble for each invoked structures each entry 
describes alioof the data bases in which that structure is 


invoked. 


Literat Table 
The fiterst table centains every Literat» numeric» 
atphanueeric» of hexadecimal which appears in the data base 
descripticn. tLiterzt table entries are pointed to cy DEL 


and Potish tabie entries. 
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Cperating Instructions 


Enter through the Gperatcr Dispiay Terminat (ODT): 


Syntax: 


COMPILE <catawbesesramea> DMS/DASDLANALY SYNTAX «cert cr er se ees> 


Ot hasan is i ahaa tart mam a a a ee ee eA ee ee SE PE Re OT BE eee en we ee ee ee eee ae 


1 { 
f<- <switches> *-] 


Semantics: 


<Sswitches> 
The followira svitches can be set to any nonzero yatue to 


suppress the anatysis of the stated structure: 


Switch 

Number Structure 

CreS Globats 
Ors/DesoL Gtobais 
Audit FPSB 

CIL Tebte 

Peth Table 

Key Tebite 
Attritute Table 
Fetist Table 
Structure Records 
CFHKH Tebie and Fide Records 


CON TUE Ww Ne S 


NOTE 


Because of the interrelation of the DOFH table and the 
fite reccrds» these items are decoded together. The 
name table and strtcture name tabdle are used in the 
deccding of the COL table and structure records» 


respectively. Literati table entries are used in the 
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decocing of the ODL anc Polish tabtes. The 
CMS/CASCLANALY procram does not decoce the invoke 


tatle. 
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SECTION 8 


O*¥S/DELOCK PROGRAM 


The CMS/CBLOCK program tecks the data base dictionary» which 
prevents updating during a specific time period. The cata base 
cictionary is not tocked when openea inaquiry. This mezgns thet 
white SYSTEM/CCPY is betrgq used to tackup the oata baser the 
Cictionary is not tocked and it is possible to run an update 
program against the cata basee This is highty undesirable since 
this can result in versicn mismatches in the backup copy of the 
cata basee Therefore» it is recommended that the OMS/CBLOCK 


program be run just kefore the data base is to be backed up. 


Syntex dictionary: 


EXECUTE CMS/CSLCCK FILE CICTIONARY NAME wernt m nts estes ener clamlcaeae 


bd = = == - 


>pee- <familyname>/dzta tase name>/CDICTIGNARY ser renn er nn ee enna nnn 


If the data base dictionzery resides on the system pack» the 
<family name> i858 not necessarye To send the DMS/DBLOCK gcrogran 
to erd of job CECJIs thereby unlocking the dictionary» a tlank 


eccept (AX or AC) system com@and is enterec: 
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<jot number>aXx 
The DMS/TELOCK progrzm cen be used at any time to tock the 
cictionary file and prevent updatinge It can be useds fer 
exemple» while troubleshcoting a data base problem to prevent 
users at remote stations from siqning on to an update proaram. 
The user shoutc remenber that the dictionary is not tocked 
against upcating when a TUPDATE DMS/DASDL compile is runnings the 
CMS/CBMAP program is runrings or when the SYSTEM/COPY program i156 
accessing the cata basee Therefore» if the cperator does not 
wish the cata base tc be updated while any of the abcve programs 


are runnings the OMS/DELOCCK program must te used. 
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SECTION 9 


D*¥S/DEBACK PROGRAM 


The OMS/CBBACK progres cenverts the data tase dictionary from the 
Mark 11.0 release back te the Mark i0.0 release» The DMS/DBBACK 
program is run against a Mark 11.0 gata base dictionary and 
converts it to a halfway point. OQnce this has been cone» an 
upcate (8 UPDATE option) comrilation of the cata base must be 
cerformed against the data base dictionary under the Mark 19.0 
operégting system. The O*S/DEBACK program is run by file equating 


the groper dictionary. 


Syntax: 


EXECUTE CMS/CBBACK FILE CICTIONARY, NAME ser eter ner reeset ennrcnn= > 


>-= ¢<family name>/<cata base name>/DICTIONARY were rr er es ec seer e-] 


The cperator must tate tke resulting dictionzgry anc perform an 
upcate (€£$ UPDATE option) compilation of the cata base zgainst the 
cictionary under the Mart 10.0 operating system. This creetes a 
usable Mark 10.9 dictionzry file. The cperator must be certain 
the cata base source file is used as input to the upcate 

(8 UFDATE cpoticn) ccoapitetion of the data base and the scurce 
file contains no other ctanges to the data bésee~ There can te no 
FURGE or GENERATE stztements» the data base description cannot 
have changed ir any say» nor can there be a $REDAGANIZE statement 


in the source. The cictionary must be the onty data base file 
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effected ty this procecure. If the <data tase name>/REORG.READ 
anc <data base name>s/RECKG.WRIT proyrams are created as 2 result 
of the SUPCATE compites the procedure was not successful and the 


cictionary is not usable with the Mark 10.0 operating system. 
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SECTION 10 
DMSSAUDITANALY PROGRAN 


The CMS/AUCTTANALY progrem decodes a DMSII audit file» printing 
the contents of each audit record» including recore type» 
structure numbers» anc cortrot information such as togicat 
adcresses» previous zudit seriat numbers» Next Available Highest 
Coen (NAHQ) fietcs» enc tey values. As an options the contents 
of cata records» bott betlore and after ig2zges» are aiso printec. 
The operator can aisc specify criteria for the inctusicon cr 
exclusion of audit recorcecs from the printec Listing and/or 
specify that the audit files are to be fourd on 2 hardware device 


other than the defauit device. 


The printed listing includes the auait type in hexadecimal! format 
énc the structure nuaber in decimal. These fields are followec 
ty a descripticn of the eudit recora types a 32-bit aucit seriat 
rumber» ana the togical eddress of the block affected ty the 
upcate being auditeds ttese fields are fottowed by information 
specific to the gucit record type. Additionatty» whenever 
informatior is printed from egny given biock within an audit file» 
the relative tccaticr of that block within the audit file is 
identifieds along with the tElock numbers the Listing includes 
the beginning and encing audit serial numters for the records 
within that biccks The current audit serial number for each 


gucit record is printeac zt the right marcin of the Listing. 
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GPERATING INSTRUCTIONS 


The CMS/AUTITANALY progrzm can be executed by geans of an EXECUTE 


or CCUCMPILE statement. 


Syntax: 


COMPILE <data base néme> DMS/AULITANALY SYNTAX scr ermneennncnwnnnnn] 


cr 


EXECUTE OMS/AUDITANALY 


NOTE 


If executecs a DATABASE cr DA statement must be entered prior to 


eny other oapticns 


CMS/AUDITANALY CFPTIONS 


After the crogram hat been executed by the compile or execute 
Statements» the DYS/JALDITANALY program expects options to be 
entered» either ty the accept CAX os AC) system commend or 
through 4 card reader. The format of the options is the same 
whether erterec by accept CAX or AC) system command or through a 


card file. 
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syntax s 


l<---<- , one wm oe | 


eae KON TON? tert = 2S 22 Sa Se ee * 
j 1 


Semantics: 


<option> 
The <cption> fielc specifies the option to be usede Reter 


to Cpticn Specitications for the complete description of 


each cption.e 


ENT 
The END keyword tersinates input of the options for the 


OMS/AUDITANLY progrem. 


The perioc f») charticter terminates input of the options tor 
the CreS/ALDITANALY rrogram. Severat options can te entered 
at cre tigwe by saeant of one accept (AX or AC) system 
command» or indivicrial options can be entered with separate 
accept (AX of AC) systew commands. If the options are 
entered thrceugh a cera file» they can be entered with 
severai options per card or one opticn per card. In either 
case» when enterine several options at oncer the options can 


be separated by a ccmma (9) or semicolon (3) character. 
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Fraqmatics: 


Frinter Cutput 
Alt printed outgut is directed to a Fackup print fite 


tabeleds 


<cata base rameod/AUDITLIST 
Both printed anc citpday output default to tower case but 
can te chanced to upfper case by setting switch 3 to a4 


non-zerc valuee 


Yhe internat file nzme for print fide is LINE. In order to 
make the print file viewable at a terminal» the reccrc size 


of the file can be wodified as fottows: 


WCCIFY OMS/ALCITENALY FILE LINE RECORD.SIZE 603 


Minimum record size attowed is 70. Maximum is 132. 


STATUS 
Entering the STATUS comgand by means of an accept CAX or AC) 
System after aif options have been entereds causes the 
DMS/JAUDITANALY crogram to dispiay how far it has processec. 
The fclloning shows the format of the status messages 
Block <biock nunber> of Auait file <audit file rame> - seriat 
number <audit serial number> 
If errors exist in the audit file» then the fottowing is 


aiso displayed: 
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<number> errcrs in the auditfile 
Cptions anc Commanc Strings 
Options ard coga@and strings may be split across input linesr 
but no word may be troken across input tines. Valid 
commands to the DMS/AUDITANALY program consist of the 
following: 
CATABASE statemert 
FILE <fite orptiors> 
ASNS <asn options> 
STF <str options? 
TYFE <type optiors> 
CPTICN <print options> 
vERIFY 
STATISTICS 
Frograg Switches 
If switch 2 is equal to a nonmzero vatue» commands are 
expectec throuch an unsequencea data file or card file naaed 


CARC. The cefautt tardsare type for this file is disk but 


can be cverridden by a MODIFY system cogsmand or file equate. 


CPTICN SPECIFICATICNS 


The syntax and functions of the various options which away te 


specifieo to the UMS/AUCDITANALY program foitton: 
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CATABASE Statesent 


The CATABASE statemert icentifies the name of the OMSII deta bese 


in which the audit files are to be anatyzed. 


When the DeS/AUDITANALY rrogram is executed» the DATABASE 
statement wust be the first statement enterec prior to any other 
optionse The CATABASE statement is not used when the COMPILE 


Syntax is specified. 


syntax: 


DATABASE <cata bese rame> rater ment m nese nen e nce teen ne ence ce nnnee-] 
i 1 
In-- ON o-""- <fawity name> --1 
i ‘ 
i-- DISK ------ ital 


Senantics: 


CN 
The CN keyword specifies the location of the data base 


dictionary file. 


CISK 


The teyword OIS® refers to the system peck. 


data tase name> 
The <cata base rame> fietd specifies the name of the cata 


baSEC a 
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<femily name> 
The <family name> fietd specifies the pack name of the CMSII 


data Lasse. 


FILE Statesent 


The FILE statenent specifies which audit files are to be gnatyzed 


ty the DeS/AUDITANALY precgram. 
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Syntax: 


FILES teeter en meee cnn eee enn enn n nee - wm tee en ee ne en wenn ee ee ne ---- “<--> 


eme- 
bo--= <number I> toee enter een tere en nnn n st ec creer er enn] 
re. i 

Panne GNLY sete t renner es nn cre r ne n-=] 

1 i i 1 

f-- FORWARC -~1 

t Boer 3 i 

i 1 i i 

1 I-- REVERSE --1 i 

‘ --- i 

i 

f---~- 10 <nusber2> ---<-- sla alla | 


SSeS = ON S22 228223: 218K. e<e3S2ees=s-< oman wena on as ansune = | 
{ { 
Y=-- PACK <famity name> ~~! 
' | 


Im- TAPE ween nn renner nnn 


semantics: 


«number i> 
The <numberl> fietd specifies the stéerting audit file 


number. This number must be a decimal titerat. 


<number2> 
The <rumber2> specifies the engaging aucit file name. This 


number must be ~ decimal titeral. 


FCRWARLC 
Tne FCRWAFD keyword specifies that the gudit file is to ke 
processed in the forward direction. If the starting audit 
file ruaber (<rumteri>) is greater than the ending file 
number (<rumber2>)» the files are processed in reverse orger 
starting with the higher audit file numter. The 


DMS/AUCITANALY program processes audit fites forwarc ty 
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defautt. 


REVERSE 
The FEVERSE keyword specifies that the zgudit fite tis to te 
processed in the reverse direction. If the starting audit 
file rumber (<rnumberl>) is greater than the ending file 
numter (<numberdzd>)» the files are processed in reverse orcer 
Starting with the higher audit file numter. The 
DMS/AUDITANALY crogram processes audit files torwaére by 


defautt. 


lee 
The keyword 76 is required when specifying an ending audit 


fide number. 


Pragmatics: 


If onty the starting file number is entered» the DMSsALDITANALY 
program processes aid aucit files» teginning at the specified 
file numter» until there are no more audit fites. When this 
cccurs,» the fottocwine message is displayed on the ODT: 
"If Audit fite <number> Ctitle = <audit file name> is 
avaitabdes» then erter "¥" else enter “"N" ” 
If the file exists» it stoulda be mage present and the tetter Y 
entered through the COT. If the letter N is entered» the program 


terminates. 
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If the audit files are tecated on media other than that on which 
they were createcy» the GP <CISKs PACKe or TAPE> opticn can te 
specifiece CISK refers to the system disk. PACK specifies é 
user pack. 4f TAPE is srecifieds the audit files cn téepe must be 
in the same format as on disk Cincluding tte same block size). 
This means that SYSTEM/CCPY tibrary tapes cannot be processed ty 


the CMS/ALTITANALY progrzm. 


if the aucit file is a ctntinuation audit fite Caudit files 
gerecduced autcomaticatiy dtring a run when the previous cudit fite 


fecomes full)» the REVERSE option must be snecified. 


If no FILE specifications: are entered» the DeS/AUDITTANALY program 
uses the audit File Faraweter Block (CFPB) in the date base 
cictionary tc aetermine the default device type and the starting 


zucit file numcer. 
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STRUCTURES Statesent 


The STRUCTURES statesent specifies indivicuat structures or types 


ef structures to be znatlyzed. 


If the SIRLCTURES statement is not specified» data images are 
printed for afl structures in the audit file by defauit.e. If the 
cperator wishes to print adtl structures without the data tmages» 


the STRUCTURES ALL keywords must be specified. 
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Syntaxs 


=a Sees q 1 
or, > f= ALL, Seems eae Sara S SSeS == 
“== 1 i 
12° DESO INT eseer eo Sa lag <-SbT “sees 
4 1 i 14 
! I-- DATA --1 ! 1 
4 i | 
4 t= DATASE Ar eressese7, “ 
4 i 
2 VG) 2222 ster St eS ee ee sala 
4 t 
fae 5 sess ease eet es Tass se meme | 
! J 
i? ES 22a Se eS eres eer ee eee ee eee ee 
, i 
[obs Sees sees Se Se ee 
1 1 
f= = “ERBTOULD ee Seeeereeseer ss SE) eee 
1 1 j 1 4 
1 inm- DATA ~~] i o4 
1 { toi 
q in~ DATASET em----- s-4. 4 
| i 
pe LOK Sees = == sSeo aaa a i 
1 
f= TURP AN. 2S 3 Stas ose ass 2 see ees es een = 
t ! 
[ee TDRSEO: Ses Seer Se tees Serre res es eS er] 
| i 
ime INDE Stet eee re Sees ee aaa ee 
I 1 1 | 
! i-~ SEQUENTIAL --1 I 
| 1 1 ! 
1 im RANDOM ~er-~1 i 
| 1 
Lo MWANCAL- SUBSE FP Sere er assesses ica | 
! 1 
$e: MSS, Sheer asa aes s pera ieee nadia see 
1 i 
i=" <sttucture nane> =“ see sferecss eee 4 
1 i 
Im «structure number> ~wercreree- Tao ee es 
> nm new ewea we wee ee 6 we es SO ee ee ee eee ee ee eee se 
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j-- 


I 
IM@GES --1 
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Semantics: 


Keywords 
DDS 
DISJCING 
DISJCINI 
OQOISJCINI 
DS 

EDS 
EMBECCED 
EreBECCED 
EMBECCEC 
ES 

(0x 
TOXRAN 
IDXSES 


AREAS “= 


1 


STYPES 


CATA SET 
CATASE 
SET 


CATA SET 
CATASET 
SET 


INCEX SEQUENTIAL 
MANUAL SUESET 


MSS 
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<numter> =--- 


1 
1 


TO <number> 
1 
4- BLUCKS <numter> 


“a oe i 


{wae » 


weeeen- BEFORE --7-------- a atelaletetatataetatateiatatatae 


I 1 
AFTER -~-~-1 
i i 
SPACE --<1 


The foltcwing vatlic structure types can be entered: 


Structure Type 
Disjoint data 
Disjoint data 
Disjoint data 
Alt indexes 
Any data set» 
Embedded data 
Embedded data 
Embedded data 
Manuat subsets 
Any embedded structure» EDS or MSS 
All indexes 

Index random sets 

Index sequential sets 

Index sequential sets 

Mantal subsets 

Manual subsets 


sets 
sets 
sets 


disjoint or embeddec 
sets 
sets 
sets 
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AREAS Laer 
Chu 
The AFEAS keyword strecifies ranges of, addresses for a 
structure. The <nunber> field can te either deci#at or 


hexadecimait titerats. 


BLCCKS | i 
1) DoS Hock Ws OMe Gt hang ( Mas 
The keyword specifies ranges of addresses for .a structure. 
The <nuasber> fiela can be either decimat or hexedecinatl 


literals. 


CATA 
The CATA keyworc catses both before and after imaces to be 
printed. For ar incex structure» the individual tabte 


entries are prirteda 


CATA IMACES 
If the DATA IMACES teywords are specified» both before anc 


after images are printed. 


SYTPES 
The STYPES keywerd specifies that BEFORE» AFTER» or SPACE 
keywords follow. STYPES BEFORE causes the before imaces to 
be printec»y STYFES #FIER causes the after images to be 
printed» and STYPES SPACE causes the space aliocaticn 


reccres te be printed. 
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<structure name> 
The <structure rame> fiela specifies the name of the 
structure to be analyzed in the audit file. ‘it the 
<structure rame> fiedda equats any of the keywords for 
structure types» the <structure name> fietd is used to print 


the audit recorcs 


Z 


<structure number> 
The “structure rumber> fietd specifies the structure number 


to be analyzea in tte audit fide. 
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ASNS Statesent 


The ASNS statewsent centrels printing by using a@ range of audit 
serial numbers withir the scope of the files specified with the 


FILE staterent. 


If the ASNS statement is not specified» vatues for minimum and 
@aximum aucit seriat numters are de and @FFFFFFFF a» 


respectively. 
ayntaxs 


ASNS ecrrc> FROM ec<stert number>s TO atend numberda --*- e777] 
I-~ FROM «<stert number>« --77° ad a a 1 
1 1 
f-- TC aXxend rumber>Q weet tet ewes eres seer sscee=| 


Semantics: 


FROM 
The FROM keyworc catses the analysis to begin with the aucit 


serial nusber specified by the <start number> field. 


10 
The TC keyworc causes the analysis tc end with the aucit 


seriat nusber specified ty the <end numter> field. 
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TYPES Statement 


The TYPES statement specifies which audit types are to be 
crirted. the cperatcr can specify that specific audit record 
types be printed or that all audit records relating to a 


particular structure type be printea. 


Syntax s 


J tw en ewe owe , 2" 2 a ae ao esa am ae |} 


TYPES cr-r-- <audit recerd type> ----- aati atte atalaaateatatates --- 


I-- AFVER soeeeen nen nnn--I 


I-- BEFORE ~-------- wrnn---1 
i i 
I< CONTROL -oeeneeee nnn -) 
Ios = - i 
i i 


I-- SPACE seceennneen-----] 
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Semantics: 


<agudit recorc type? 
The <audit reccrd type> field must be entered as a tworcicit 
hexadecimal Literal enctosed in at sion (a) characters» and 
must reference satlic audit record types. A tist cf vatid 
audit reccre types can te founa under Audit Types in 


appencix F of this wanual. 


AFTER 


The AFTER keyword prints after images. 
EEF ORE 
The BEFGRE keywerad rrints before images. 
COATROL 
The CCNTRCL keysord prints controi records. Control records 


include data base cren ard closer» syncpcintsr ceontrolpcint» 


and cprogram abort records. 


SPACE 


The SFACE keyword prints space aldocation records. 


TABLE 


The TABLE keyworc prints recoras retéeting to index tables. 
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CPTICGCNS Statenent 


The CPTICNS statement cortroits the tormat of the printed output. 


Syntax: 
CPTLERS SS 2 o at SS 28 SSS Sees Ce Sn Se Se See See Sees eee eS eee me | 
one eee | | { 1 
f--~ SINGLF ---1] j-==— UPPER <<-1 
1 1 i 1 
i--~ DCUBLE --=-1 fe-- LORKER ---1 


Semantics: 


COUBLE 
The CCUELE keywerc tauses the dine printer tisting to be 


doubted spaced. The default is singte spacing. 


LOWER 
The LCWER keyword aliows the tine printer output to use 


lowercase tletters. The defauit 15 towerrcase letters. 


SINGLE 
The SINGLE keywerc causes the tine printer listing to be 


single spaced. The defeult is single spacing. 


LPFER 
The UFPER keyword czuses the tine printer output to use 
upperscase tetters cnty. The aoefault is lowercase letters. 
Upperccase fetters cnty can be specified permanently Ly 
settirg program switch 3 to a non~zerc value using the 


MOOIFY (MC) com#and. 
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STATISTICS Statesxents 


The STATISTICS command prints certain statistics about each OmsII 


aucit file. 


Syntax: 


STATISTICS 0 TO SOOO ee ee ee mam | 


Pragmatics: 


The STATISTICS commard czuses statistics to te printed for each 
augqit file specified in the FILE statement. These statistics 
include the number of each data base structure accessec in the 
gucit files as well as the total number of syncpoints» 
controipcints» and efrore in the augit file. The STATISTICS 
capabidity is set by defzult if no STRUCTURES or TYPES statement 


1s entered. 
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VERIFY Statesent 


The VERIFY staterwent verifies the integrity of DMSII audit files. 


Syntax: 


VER {Ff Y Tee ee eee errr rer er eT Pee CP ere te rey ST ee re Se er se ee oewacecee eam | 


Pragmatics: 


kKhen the VERIFY commenc #8 specifiear no audit records are 
printed. Insteade ezch eudit file specified in the FILE 
statement is read anc verified to determine if errors exist. 
When the VERIFY commend 3s specifieas the STATISTICS capabitity 


is set by cefarit. 
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Fite Nagzes 


The foltowing are the internal and externat file names used by 


the CMS/AULCITANALY progrem. 


Internal Fxternat 

AUDITFILE #UDITFILE 

LINE «date base name>/ALDTILIST 
CICTICNARY «data base name>J/DICTIGNARY 
CARO CARD 
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Switch Settings 


Tabte 9-1 Shows the 


program. 


Table 9-1. 


Switch Value 


2 ) 
2 1-15 
3 0 
3 1-15 


valic switch settings 


CMS/#UDITANAL Program 


Result 


Input is expected 


Input 15 expectea 


for the OMS/AUDITANALY 


Switch Settings 


trom the OCT. 


from the fite CARD. 


Fil output as in tower casee 


Fil cutput ais transtéated to upper case. 


NOTE 


An AX system ccamard overrides switch 2 and input is 


expected from 
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the (DOT. 
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CMS/AUDITANALY Exaspies 


The foltowing are exaemptes of various ways to run the 
CMS/AUCDITANALY progrzm. Note that aa perioc (.) chéeracter 
foilcwing gn option strirg terwinates the entry of optiors to the 
CMS/AUCTTANALY progrzem. The key word END can atso be used to 


terminate the entry cf ortions. 


Frint Aucit Fites 1] Through 5 
To print the cortents of audit fites 1 through 5S» the 


fottowing cowmards can be used: 


EXECUTE OMS/AUCTTIANALYSZ AX Db <data bese name> FILE 17C5 . 


EXECUTE CMS/@IUCDTIANALYsS AX Db <data bese name> CN <pack name> 
FILE 1 TO 5. 


EXECUTE CMS/AULTIVANLY*AX DB <data base name>s AX FILE 1 TO 5s 
Ad} ENT" 


CCWPILE <datée tate name> DMS/AUDITANALY FOR SYNTAX 
<job #@> AX FILE 1 10 5» EwD 
Frint Auctt Fites 1 Through 5» Betore/After Images 
To precess audit fites 1 through 5S» but only print entries 
for disjoint data sets with their before ana after images» 
the fcolloxirg ccmmards can be used: 
EXECUTE OMS/AUDITANALYSAX Do <data bese name>sAX FILE 1 TO 5s 
AX STR CISJOINT CATA SET DATA IMAGES? AX END™ 


EXECUTE CMS/ZAUCTITANALYS AX Ds <data base name> FILE 1 TC 5 
CN PACK <peck> STR ODS DATA .* 


CCePILE «datz tate name> DMO/AUDITANALY FOR SYNTAX 
<job #@> AX FILE 1 TO 5 GN PACK <pack name> 


<job #> AX STR CDS DATA IMAGES 
<job #> aX END 
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Frint Aucit File #4» Structure #7) 
To analyze onty audit file number 4 and print only aucit 
recorcs for stracture number 7 with statistics end no dété 
images» the fottonirg commands can be used: 
EXECUTE CMS/AUDTIANLYSAX 0B <data base name>sAX FILE 4& ONLYS 
AX STR 7s FX STATISTICS? AX. 


EXECUTE DMS/AUDTIANALYSAX Db <data base name>» FILE 4&4 CNLY¥e STF 
STATS» 
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SECTION 11 


CTMS/OB8MAP PROGRAM 


The CMS/CBEVAP program checks the integrity of a data base. It 
can be run against a OWSTI data base if that data tase is not 
currently cpened updéetee. Acditionadiy» the OMS/DBMAP program 
crints stricture infcrmation from the data base dictionary itn & 
more reacatie form than that given wy the DMS/DASOLANALY progrém>s 
performs poputation summzries» and prints cata from the cata base 
Cin hexacecimai). The vérious options possitie are given to tte 


CMS/CBMAP crograa by mears of accept (AX or AC) system commands. 


The foltiowing terms gre aesed by the DMS/DBMAP program to refer to 


the various data base structures. 


Keysymbot Structure Type 


CBS Disjoint data set 

Cs Any datz set» DOS or ELS 

EDS Embeddec data set 

ES Any embedcec structures EDS or M35 

10x Index sequertiat set or subset or ar incex randem set 
IDXRAT Index réndow set 

IOXSEE Index s€auertial set or subset 

SS Manual subset 
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CPERATING INSTRUCTIONS 


The CMS/CERAP program car be initiated with a COMPILE statement 
or EXECUTE statewent. With the EXECUTE statements» the data base 
rawe must Le suppdiec ateng with the commends ty means of a 
commenc fide or accegt CFX or AC) system command. With the 
CCOVPILE stéetement»y tke czta base name is specified within the 


CCHPILE statement» irdepenaentiy of all other commmands. 
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Syntexs 


COMPILE <cata base nare> OMS/DBMAP FOR SYNTAX“="-=<= 


EXECUTE LNS/DBMAP < 2-2 see nnn nnn nnn nn nn enn ene nen - =e 


7 


jDsesan an eae €switches> 2 we a a ww 2 oe an ee ee ee ee ee ee se 


I i 
I-- <faile ecuates> ----" nt: | 
1 i 
fe- <virtuadl aitsk> ----- n= | 
i i 


t-~- <AX of AC ceommand> --74 


Semantics: 


<AX or AC coamana> 
Refer to the Accept CAX or AC) Systews Command in this 


secticn fcr a cemptete description. 


«file eatates> 


Refer to Fites in this section for a complete description. 


«switch settings> 
Refer to Switch Settings in thas section for a corpiete 


description. 
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<virtual disk> 
Refes to virtual Citk in this section fcr a comptlete 


descripticn. 
Pragmatics: 


Executing the CMS/CBMAF Program 
Tf the UMS/COMAF pregraw is executed rather than compiled» 
the name cf the datz base must be entered through the OOT. 
The O*S/DEMAP progrem must be executed if more than one déta 
base is tc be meppet.e When executed» tke DMS/DBEMAP progréem 
requests ¢ new cata base name at the coaspteticn of the 
mapping of each date base and proceeds to end of jot CECI) 
when tlanks are entered. If the switch settings are to be 
different for ezch cata base» the settings must be changec 


prior to enterirg the new data base name. 


Conpiting the CMS/EBMAF Program 
If the CMS/CBMAF pregraw is compiteds» the <datasbzse-name> 
inclucec in the comrile statement is used tc automaticatty 


locate the data base dictionary. 


CLictionary on User Pact 
If the data base cictionary resides on & user packs the 
€datathazse-name> in the COMPIL&t staternent must te of the 


form: 
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<pack-1id>/<di-natre>/ 
If the CMS/CBMAF pregram is executed» the secone virguie (/) 
character is optionzt when entering the name of the cata 


base through the ODT. 


SWITCH SETTIAGS 


valic switch numbers for the DMS/DBMAP progrem are i» &» and 9. 
These switches contrect wtere the DMS/DBMAP program tooks for tke 
commands ard some of the prirting parameters. These switches can 
cnty be set to beotedn veluess that is» 0 or 12 Tatte S-2 shows 


the vatue ana result of ¢ach Switch setting: 


1152444 11-5 01/19/84 


Table 9°2. OMS/DBMAP Program Switch Settings 


Swite Vatue Result 
1 0 Cowmands are expectec from the OCT. 
1 Commands are expected from the fite CARD. 
8 0 GCutput is in dower casé- 
1 Cutput is in upper case. 
) 0 Alt blank tines and page skips are 
inctuded tn the output listing. 
1 Blenk Lines and page skips are 


sufpressed tin the output listing. 
If switch 1 is not set» the commands are expected Ly means of 
accept CAX or AC) system commands and are prompted for if 
recessary. fhe exceptior to this is the use of the COPPILE 
stetement. If the COMPILE statement is entered without an earty 
eccept message» OMS/TBMAF performs a default run acainst the déta 
tase and dces not atiow eny commands to te entered to it. The 
presence of an earty accept sessage overrides any setting of 
switch 1.2 When usince the COMPILE syntax under a usercodes the 
WCF automaticaliy sets seitch 1 to ie In this situations the 


operator must explicitly set switch 1 to 0 if so desired. 
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FILES 


The three files used by the DMS/DBMAP program are describeoc here. 


They can be wocified by seans of fiie equates. 


LINE 
This is the output crinter file. Its external name is <déta 
base name>/*AP-LIST GN <data base pack> but can be changec 


by @ file ecuate at run time. 


CAFD 
When the CMS/0CBPRAP crogras is sun with switch 2 = i» the 
data tase name Cif the EXECUTE statement is used) and the 
commands are rezd from this file. The default exterrat name 
is UMS/CBKVAP“CObs, bet it can be filerequatec to any cisk 


fide. The disk file must not inciude sequence numbers. 


FIctx 
Fite FICX reads index tables when performinc validity 
checking. For speec and optimizations it is best for this 
fite to héeve one wore buffer than the number of tevets in 
the ceepest index sequential set in the data base. Howeveres 
Since index tables can ke very large» this coulc prove to te 
too much space for ‘ome systems. The number of buffers for 
this file is set to 5 by defaudt» but can be modified with a 


file equate. 
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WIRTUAL DISK 


Virtual disk is required to save paged arrays~e [The zmount of 
virtual cisk assignec to a program can be controtted by the 
VIRTUAL _CISK program attritute. It is not normadiy necessary to 
alter virtual cisk» tut when doing an extended vadidity check cn 
adarge cisjcint datz set the value of the VIRTUAL_DISK program 
attribute say need tc be increased. Durins extended vaetidity 
checking of a cisjoirt deta set (DDS)» a bitmap of the availabide 
chain is buiit. The virtual disk requirec for this is: (Cnumber 


cf open records) / 1440. 


ACCEFT CAX of ACJ SYSTEM COMMAND 


The accept CAX or AC} system commana can te used in the COMPILE 
stetement to supply commends to the DMS/BBMAP progras» anc in the 
EXECUTE statement toe suprliy both the data tase name ena the 
commands. A period (.) character concludes the command string. 
{ff the perioa (-} chéracter is not inctludecse the D¥S/DEMAP 


program expects aeditiorzi input. 
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Coggands 


The coammancs controt the tevet of checking apptied to each 
structure cr group of structures». Commands can be entered froa 
the CDOT by mears of eccert commands» or from the CARD fille Cas 
cescribec in the paragrarhs entitiled Switch Settings). In 
either case» the syntax 3s identicat except for the comma (») or 
semicolon (3) characters which is optional between compsands 


entered by means of gccert system commands. 


Commands can be in upoer or lower case and cén be arktitrarity 
split across lines» elthcugh words cannot be split. If the 
commanas are entered frow a card fide» the end-of-fite record 
terminates comm#and ircut. If the commancs are being ertered 
through the COT» the protram keeps prompting for more cogmands 
until the pericd €.) character is enterd. A4l commands entered 
are frintec cn the first page of the output tlisting etong with 


gény errors they can cenerate. 
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Syntax: 


[cme rrr ere 5 ce ee mere ce nen mn nnn eee ene n rence nee ee ----1 
l i i i 
t oe are ' 
I 1 
‘ores <€Ciata base Nake> “982 9999S Ss 23 ose ows Se ae ee ee oe eee SS 


| i i i 
1 i-~- ON <pack name> ““-~-"7] I 
1 1 
tsee= ALL S<s8 e032 eereeeeese= 2. Se= EXTENDED VALIDITY == <-=">1 
i { 1 i - 1 

i 
Im EXTENDED VALIDITY PRINT -~1 
= sa 1 

i 

a fh SS Sess Sees ee Se See] 
-_ i 

- <str id> wets cesses eeee |] i | 
1 I t= NAHOG COUNT <<<9"er%*e="=-] 

i- CLUSTER 3 i = i 

] 

J- STATIC INFOQ secre crecsr es] 

= 1 

i t 
t= VALIDITY Seer =< =225 ==<=] 
= i 

I 

f- VALIDITY PRINT «-<-272-2--] 


} 

! im OLS 3% 
1 1 { 
1 Peo ES, =") 
1 4 j 
I te- IfX ~-1 
{ 
1 


am oe ti ah ae 
eat 
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Semantics: 


<data base name> The <cata base name> fielc aust appear as the 
first command entered if the EXECUTE statement is 
specifiec. fhe «deta base name> field must not te entered 
if the COMPILE statement ts epaeditiee since the name of the 


data base 18s specified in the COMPILE statement. 


ALL 
The ALL keyword causes ati data base structures to te 


incluced. 


ALL ODS 
The ALL CCS keysymbcls cause ait disjoint data sets to te 


inciucec. 


ALL ES 
The ALL ES keysymbo"s cause ali embedded structures» toth 
embecced cata sets and manual subsets to be included. then 
the VALICITY keyworc is specified for an embedded structures 
walidity checkirg it also applied to the parents and 
grandparents of that structure as well» meaning this 


operation can hzve far-reaching effects. 


ALL IDX 
The ALL [CX keysymbcts cause all index sets» toth index 


sequertiait anc inde? random to be inctuded. 
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<str ida> 
The <str id> fielc wust be a data set and inctudes the 
structure. <str ic> can be the structure name cr structure 


number e« 


CLUSTER 
The CLUSTER keysord causes ati the descendents for «str ic> 
to ce included. The descendents of a structure incluce aft 
embeccec structures for that data set as well as their 
embecced structirese Aiso» any index structure which has 


<str id> gs its object is included. 


KA 
The KA option czuset the structure to be inctuded in the KA 
suq@mmary et the becinning of the Listing. There is no way 
to exctude a structtre from the KA Summery» but specifying 
this cption assures that no greater amount of checking or 
printing is pertormed. This is the dcefauit for any 


structures rot referenced by any con@and. 


STATIC INFO 
The STATIC INFC option causes the static information from 
the dicticnary structure record to be printec. This is the 


defauit when neo comnands are entered. 
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NAEKO CCUNT 
The AAHC COUNT cpoticn verifies the NAHO chain for the 


structure to be and prints a summary of the populztion. 


VALIOITY 
The WALIDITY option checks the integrity of the structure. 
This inctudes fdaggqing all errors fisted in the error 
secticn except those few only avaitatie when the EXTENDET 
YVALICITY CHECKIAG oftion is specified. When the VALIDITY 
option is requested on an enbeaded structures checking is 
aisc perforwed na tte parents of the structure ¢nd so one up 
to the cisjcint datz sete. If the VALIDITY opticn is 
requested or an index» the NAHL COUNT option is 


automaticalty irvoked for its object disjoint data set. 


WALIDITY PRINT | 
The VALICITY PRINT cpotion is similiar to the VALIDITY option 
With the edoiticn ttat all data in the structure specifiec 
is printec in a hexedeciaal format. Keys» where they exist» 
are aeccded anc prirted in atpha or ntimeric foraat. This 
option can be requested on any structures including 
embedceaoss howevers the cutput can be confusing with 
embecaedc tables cut of contexte. Without this options deta 


is only printed preceding any seported error. 
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EXTENDEC wWALIDITY 
The EXTENCEC VALICITY option reports ait errors as with the 


the VALITCITY opticn and includes the fotlowing: 


The object cisjcint date set record pointed to ty an index 


set entry 18 dezde 


The key ir the cbhjetct disjoint data set record pointed to Ly 
an incex set entry coes not match the key tin the entry 


itsetf. 


A disjoint data set record containine a dead fléeg is not in 


the NAHO chain. 


The otject cisjcint data set record pointed to ty a mranuai 


subset entry is ceac Cwarning onty)- 


The key ir the chject disjoint data set reccrd pointed to by 
an orderec wanacl subset entry does not match the key in the 


entry itself Cwarnirg only). 


EXTENDEG VALIDITY FRIN1 
The EXTENTED VALICIVY PRINT option works exacttiy the same as 
the VALIDITY PRINT cotion and prints ati data in the 


specified structure in hexadecimal formet. 
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Fragmatics: 


As the options become move complex» they Lecome more time and 
space consuming. Thereferes care should be taken not to specify 
fore options than is necessary Crefer to Performance in this 


section). 


There are a few intecrity errors which the D¥S/DEMAP program does 
rot report. These are errors whose detection relies on 
CMS/CASOL~generated cocese The DMS/LBMAP program does not detect 


the tottowing errors: 


j. Data does not sweet a verify condition. 
Ze A required field it missing. 
3. A record beloncs tf an automatic sutset tut is missing or a 


recora 18s erroreouttly includea in an automatic subset. 


he A yvariabte forsat record type is wrong. 
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FEFFCRNANCE 


For ~¢ data base that contains no embedded structures» that is» a 
flat data hase» a quick enc full validity check can be 
eccoaptished with the cowmand: ALL IDXSEXTENDED VALIDITY. The 
anty check that 15 caitted from this map is the population check 
for cisjcint data set structures. towever» problems with 
cisjoint data set poputations can be seen in the checking cf 
their incex structures. Using this command avoids an extra reed 
of the disjoint cata set structures and is» therefore» much 


quicker o 


A similar advantage can te achieved for data bases that are 
cefined as disjoint cata sets (flat data tases) with the 


fotlowing co#manc: 


ALL IEX2EXTENCED VALIDITY» ALL ESZEXTENDED VALIDITY 
In this case» cntly the cisjoint data set structures that contain 
emtecded structures ~re tead» making the saving in time 


ercperticnal te the tlatress of the data tase. 


In any case» extencec validity checking on disjoint data set 
structures only provides one additional check than simple 
valicity checking. Exterded validity checking shows which 
records cortain dead ftacs but are not in the avaitatle chain. 
Simpte vatidity checting on & disjoint data set structure telis 
the cperator that such reé€cords exist withcut showing which 


records they are. 
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COMMAND ERRORS 


If an error is ercountered while reading commands from the CARL 
files the UMS/TBMAP program is aborted. If gn error message 
cther than TEXT FOLLOWS FERICOD is disptlayec on the ODT» &@ messege 
is displayed and the comnand is skipped anc the remaining 
co@mands ere processed. An édditional prempt is then givens» even 
if the peritoc (€.) chéeracter has been encountered to aittow 
correcticn of the ergore. The possibile errors and their eéanincs 
ere tisted nexte The TEXT FOLLOKS PERIOD message always causes 
the CMS/CEMAP prograr to abort. The error messages are tn the 


forms 


ERROR IN CCMPAND INPUT. “error wsg>» SEEING? <last cowmand read> 


The possibde ccezmand errers and their meanings fottow: 


CLUSTER EXPECTED 
Neither the CLUSTER keyword nor a coton (2) character was 


found following a krown structure name. 


FESSIAG CGLOA 


No cotton (3) cheracter was found following a tegal grouping. 


*ISSING COMMA 
No cogmaCs)» senicoflon(s)» or period (.) character fottowed 


an ctherwise valid commande 
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TEXT FOLLOWS PERIOL 
Ait ccommards were yvelid»s but aaditionat command text was 


founc on the tast tYne efter the period (.) character. 


LNKNOWA ALL WARTANT 
The werd following FLL was not IDX» COS» E or a coton (2) 


character. 


UNKNGWA STRUCTURE 


No tegal grcupirg of known structure name began a command. 


UNFECOGNIZED OPVIGH 
Fottoning a watid grouping and cotton (3) characters» no vatid 


option was tounc. 
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EXECUTION EXAMPLES 


The fodidtowing are some evsamples of how the DMS/DBMAP program céen 


ke rune 


In order to produce 2 cetault map of the data tase MYDB on the M 


tacks» the following syntex can be used? 


COMPILE CBFACK/TESTCE/ WITH DMS/OBMAP FOR SYNTAX 
since eiaivek 1 is not set and there is no accept CAX or AT) 
system commands a detauit run is performed. This prints the KA 
listing cf each structure and the static information contained in 
the data base cicticrary for each structure. The same thing 


couitc atso be accomplished with the statewrent:> 


EXECLIE CMS/CBMAFZ AX TESTOB ON LBPACK. 
To perform validity checting on a data set and ati its related 


structures» the follcewine command could be used? 


COMPILE TESTCH WITH ([MS/DBMAP FOR SYNTAX; 
AM ALLZKA» CS1 (LUSTER? VALADITY. 


This accepts the cogsands from the accept (AX) system command. 
The KA option is itnveked for ali structures and data set DS1 and 


its related structures ave checked for validity. 


lo perform extenced vaticity checking on att structures in the 


cata base» use the fcllosing syntaxs 
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EXECLTE CMS/CBMAPSAX TESTDB ON LBPACK>» ALL:E. 
The foitowing commanc perforss extended validity checking on ait 
cisjcint data sets ard ircreases virtual disk for this run of the 


CMS/CBMAP program to 250 segments: 


EXECUTE CMS/CBMAPS VIRTUAL_DISK 25005 AC DEMODBs ALL DODSZE. 
The fodilowing coa@manc causes the DMS/DBMAP program tc iock for a 
cisk file rnamec CMS/CBMAP-COM for the options in order to analyze 
the cata base TESTOB on fack OBPACK: 

COMPALE CBPACK/TESTCE/ WITH DMS/OBMAP, FOR SYNTAX SWITCH 1 13 

SKITCh 8 Ils FILE FIOX BUFFERS = 3 

This command atso catses the cutput to be printed in upper-case 
tetters only and changes the number of buffers for file FIDX tc 


4 


~~ @ 
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STATUS INFCRRATICN 


The CMS/CEMAP crogran car take a considerable amount of time 
coing vaticity checking. The current status of the CMS/CDOMAP 
grcgran car be detersinec by entering the following cogmanda: 
<job number>AX STATUS or <job number> AX 3ST 
The response to the STATUS command is in the following format: 
PAPPING «str name>. SEEN <number recoras read> OF <totel nandead> 
CVERALL ERRORS: <totet errors seen>» WARNINGS <totat warnings given> 
<str name> is the nage of the current disjoint data set or index 
set that is teing checkec.e The <totat non-dead> records is 
cetermined from the rexttavailablter highest open CNAHO) chain. 
If an error occurred in the NAHO chains the response to the 
STATLS command is in the following tormat: 
MAPPING <str name>. SEEN <numbesr of records read> CF GPENEC 
<#ax records> 
In this case» *«max recores> is determined from highest open CHC) 
anc gives an upper bcund to the number of records that are 
exasined. For indexes» the number of records is equal toe the 


number of tables. 


Khen using the STATUS comand to estimate tise towards 
completicn» it is useful to know the order in which the CMS/DBRAP 
prcgram perfores its various functions. The DMS/DOMAP program 
brerforms its work in the same order no matter what options heve 
teen set. First» the citjoint data set structures are examinec 


in numerical order. After each disyoint dete set has Leen 
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examined» alt of its index set structures are examined ir 
rumericat orcer. Presence of the STATUS comaw#and is queried each 
time the ECeS/DEMAP progrem reads a record Cor tabte) from 2 
structure file. Curing the toading and summzry (KA) phases of 
the DMS/YCOV*AP crograg» tte STATUS commanc is not seer anc no 
response is givene @fter that» towever» the response is usuatty 


cuite rapid. 
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CMS/DBMAP FROGRAN CUIPUT 


The line printer outgut zlways consists of three heading pages 
(page skips can be stppressec with switct 4 set to 1) foilowed by 
the cata base map. In tte map portions each disjoint cluster and 
each index structure start on a new pagee The disjoint clusters 
are mapped in numerical erdere fottowed by the index set applying 
to that cluster» alse in numericat order» The end of the Listing 
inctudes an error susmar45 showing each structures» the numter of 
errors detected per structures and the nurter of warnings per 


structure. 


Within the disjoint ctuster map» the static information for the 
cisjoint data set anc its embedded sets Cin numerical orcer), and 
their embecded sets gre ftrinted first.» After each structure 
heeding» any errors fount in the MAO chain are reported. 
Fotlowing this» any errors occurring in the data of the cisjoint 
cata set or its embecded sets are reported» and the cata is 
printed for those structures which have their print flaqs set. 
Finatly» the pcpulation tummaries for the disjoint data set anc 
its embecded sets are printed in the same orcer in which their 
heecings appeared» ard ary population consistency errors are 


reported. 


WKithin the map for an incex set structures the order is similar 
but less ccaplexs sirce cnty one structure is involved. Again» 
the static infcrmaticn 1 printed farst» followed by any NAH 
chain errors. The integrity errors and opticnat table data 


folttow this. Finaityr pepulation summaries and any population 
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inconsistency errors are printed. 


There can be gaps in thit overall osderirng where validity checks 
have not been requestec for some structurese No mention at ad 
is made of strictures thzt have only their KA options set. 
Structures that have onty their static information options set 
have ontly their static irformation seporteds no NAHC errors» 
cata errors» or populaticn summary are printed. Structures which 
have onty their NAHO court option set have NAHC errors and a 
shorthanc form of the porutation summary printed. Ne other 


integrity errors are repcrted for these structures. 


A complete aiphabetical fisting of the errors and their meanings 
is given ir the paracrapts titted Errors» Warnings and Abort 
Message in this section. Each error meSsace aiso has a number 
that is used in this mantat for easy reference to each message. 
The number appears withir parentheses in text» but does not 


appear with the error swersage in the DMS/DBMAP output. 
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Heading Pages 


Three heacing pages always appear for the DMS/DBMAP program 


cutput - 


Fage 1 
The ccamands are titted exactly as they were reads 


interspersed with ary error messages they generated. 


Fage 2 
The data tase header consists of up to three boxes. The 
first bex contains the cata base name» structure count gnc 
SWitch settings. Tte second box appears onty if any 
abnormal status flats are set in the DM gtlotats section of 
the dictionary ~nd contzgins these status flags as well as 
the audit serial nusaber. The third tex appears onty if any 
options were set in the OM gtotals» and contains these 


opticns in addition to the audat seriat nuaber. 


Fage 3 
The summary (KA) of data base structures is tistec.e. This 
incluces the OMS/DB*AP program option in effect for each 
strictures the structure type and file informatione A 
warning message (147) is given tor any data base fide that is 
missing. An error (45) is reported for any version 
mismatche The ¢rea addresses are not printed but they are 
checked to make suré none are zero (46). The next availatte 
CNAJ» highest open (HO)» and root table addresses are alse 


validated C1l7» 18). Warnings are given for any flags set in 
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the status fieltc of the fite records (48» 49» 50» Si» 52). 


Static Inforsation 


The static inforeaticn fer a structure is found in the structure 
record of the cata tese cictionary and is printec in a reacable 
format by the CMS/YDEFAP programe For datz sets» the static 
information includes a list of embeaded structures as well as 
their ersmbeddeds. For acisjoint data sets» it inctuaces a list of 
incex set anc wanual subtet structures which point to that 


cisjeint data sete 


if any errers gre founc white processing the NAHG chain» they are 
printed iwmmediately after the static informations. Possitte 
error mességes occurring here are numbers 4» 6» 19» 37» and 38. 
Aiso» if a disjoint cata set file needed to perform an extencec 
walicity check for ar incex set of sianuatl subset cannot Le 
cpeneds then a warning message (5) 1s reported here and the 


extended validity option is converted to a validity check opticn. 
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Cata Printing 


Cata is printeo for any structure which has its print option set 
in acditicr to a vatidity option. af the print option is not 
set» then cata is printec only preceding an error. As many as 60 
fines can be printed in tuch a cases. Fewer can be printec if ¢é 
preceding error has gtrezdy caused gata to be printed or if the 
print option is alternatively turnea on and off on various 
emrecded structures sithin a disjoint ctustere Atl data set déta 
is printed in hexadecimal» using as many lines as required. Alt 
keys are cenverted to rezdable format and parts of comptex keys 
are concétenated together. Ati addresses are printed in 


hexacecigat notation. 


Cisjcoint Data Set CDEIS) Fecords 


the printout of cisjcint data set (LDS) records consists of a 
fire with the hex adcres: (new format) followed by one or more 
lines containing the date Cin hexadecimai). For deleted recercs» 
cnly the address and the message ** DELETED ** are printeace If 
error 8 is reported» the record containing the dead flaq is 
printed. fhe cata lines do not contain the tistheads. The cnly 
error that might be reported for DDS data is number 8 Foltowing 
the cata fines» the tisttead for each embecded is printed 
corsistirg of the emteacded structure nawe and the head and tzil 
ederesses founc in tte perente. The tistheads are considered pert 
cf the parent record for both printing anc vatidity check 


purposese [f the tist head or tait is invatide it is reported 
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here with error 17. 


Eabedded Structure (CES) Yables 


For each esbedced structure (ES) with a valid list head Cand for 
which vaticity checking is required) the chains of tzbles are 
rrinted. For each tezhbles its address Cold fcrmat) is printed in 
hexacecimai foticued by Its next ana prior pcinters and its entry 
counte Any e€rrors cencetning these vatues are reperted here 
inctuding error numbers 1» 22» 340 36% and 17. If the entry 
count 185 too large», the faximum is used for purposes of printing 
anc checkinge Each entry of the tabde is printed. For an 
emtecded structures the cata is printed in hexadecimal prececec 
by the key Con a seperate Line) if it is ordered. The key is 
identifiec as co#ing fron the data if it is simple ore if it is 
cospiex»s from the tatle.e. For a manuat subset» the object address 
is printed in both otd ard new foras» foitowed Con the same tine) 
ty the key if the maruat subset is ordered. Fottowing each 
embecded structure ertry» any relevant errors are reported. 

These inctude object recerd warnings for manual subsets if the 
EXTEADED VALIDITY ogction is set €41 or 42)» and key ordering and 
cuplicate errors if the structure ais ordered (30 or 32). For 
embecded structures vith comptex keys» an error is reported if 
the key coes not match the data (43). Any embedded structures 
with an embdedcec structtre gre mapped following the data line in 


the same manner as enbeoced structures within disjoint déta sets. 
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Index Sequentiat Tabies 


For index sequential CIXTEQ) structures» the tabies are printec 
in depth*first order. The root tabile is printed tirsts» fottoued 
ty the feftmost table within it (Table 1)» followed by the 
fefteost table withir it CTabte i-lJ» and so one until the fine 


tatie is reached. This can te seen in the following diagrem. 


1 Root i 
i Tabte 4 
4 
j 4 j 
§ Table 1 1 1 Tabie 2 ji i Table 3 1 
j . i | 


ee ee DI i a el i UVC Mes Ee ED Se Pe Re eee 


i 1 4 i i 


1! Table i-i1 4 1 Tabde 1°72 1 { Table 2-1 1 1 Tabte 3-1 1! 1! Tebte 3-2 1 
1 (Fine) 1 i (Fine) | 1 (Fine) 1 1 (Fine) i it (Fine) 1 


‘Oa 2 ee wae ee wh 1 2 Oe ee a oe oe a mmm we meee ee ee Dee weeesee wma e ee = m= eEeenmeenww Oe wee eS ee 


The tabies are named as thown and are printed in the order: Foot 
Tabie» Tabie Ll» Tabte i-te Table In-z» Table @» Tabte 2-1» Table 


3 Table 3-1» Table I-72» YTabte 3-3. 


A headings in a box» precedes each table. The information in the 
heading includes the table name» aduress» prior and next 
pointers» table type», entry count and audit serial number. If 
the address is invatid» then only the name and address» atong 
with a messages appezr ir the box» The invatic address that 


caused this error hgs been reported eartier. 
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Errors concerning intormztion in the tabte header and trailer are 
reported after the headitg boxe These incluce ertry count checks 
Cerror numters 41 anc 2273 and checks on the traider intormation 
Cerror numbers 3 252 ane 26). Errors are given if the prior and 
next pointers are not the addresses appearing in the adjacent 
parent entries Cerror nunbers 21 ana 24). If a prior ofr next 
fointer cf a parent sas tad» then these checks cannot te made tor 
the first anc fast tzbies belonging to that parent. A message is 
trinted whenever the check is not made. The table type is 
checked to make sure that it is the one indicated ty the parent 
tahie type Cerror number 23). If the type i5 wrong then no tlorer 
devel tables fer this parent are checked. A message is printec 


when this happens. 


The tabte data follows the heading tox. As many entries as fit 
ere printec on each fines and fotloning each tines any errors 
relating to these entrie*t are printede Each error is preceded by 
2@ tine pointing out the ecffending entry. Entries are printed in 
key/address pairs» with the address enctosed in square brackets. 
For fine tables» the adcresses are s2-bit addresses in the otject 
cisjcint dsta set» For ether tabtese the adcresses are 24-bit 


adcresses in the index sS€ta 


The tast entry on each tevel of the tree must have a nuit key 
Cali aF asd. Error number 34 is reported if this is not so. The 
tast fine table entry must also have a nuti address» and 
therefore must be entirely nutt.»~ T# this is not trues» errer 


rumber 35 is repertece These null keys appear as question marks 


1152444 11-33 01/19/84 


in the printout. Errors in key ordering Cerror number 32) and 
cuplicates Cerror ntsber 30) are reported Aiso» each key is 
coapared to the key in tte parent entry pointing to this table. 
ho key tn the table sust be greater than this parent key Cerror 
rumber 31). If exterded vatidity checks are being per formed» 
then the otject record it read» and errors concerning its 
existence Cerrcr numter 41) and key Cerror number 42) are 


reported. 


If» while processing tables» an attempt is mzde to read gore 
tables then there aree then a circudar tabte pointers error 
(error numkter 7) is reported» anc processing of the structure 
ceaseSe Usuaiiy there are quantities of other errors ty the tise 
this is ciseivereds It is more an escape for the DMS/DBMAP 


prcaqram than a useful error by itseif. 
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Incex Randoa Tabies 


For index random CIOXRND) structures» the tabtes are printed in 

tasettabde order. Each ronsempty base table is printed» followed 
ty any overflow tables it can havee An empty tase table actralty 
cortains ore entry» the cmega entry Catl eFas). Error numter 10 


is reportec if it is misting. 


For ati norvtempty tables and for empty base tables that have 
errors» 2a heading» ir a tox» precedes each tebte. The 
inforwation in the headirg inciuces the table name» adcress-» 
prior anc next pcinters» and entry counte The base takbte for 
hash watue n is namec Tatie BASE-n 205 its overflow tables are 
ragec Tabte EASEtn ti Tzbte BASE“-n 225 ano so forth. If the 
edcress is irvatids then onty the name and address» atong with a 
gessage» appear in tte tex. The invalid next address causing 


this is reported earlier. 


Errors ccrcetning intormztion in the table header and traiter ére 
reported after the heacirg boxe. These include entry ccunt checks 
Cerror numbers Li anc 22) and checks on the traiter information 
Cerror numbers 3s 259 anc 26). The prior pointer must be the 
aéderess of the base tabte Cerror number 24) gs well as a vatia 
edcress Cerror number 173. If the next pointer is invalid Cerror 
rumber 17)5 an invalid next address error (error numter 20) is 
also reported. The type must always be zero for index rarcor 
structures Cerror nugber 28).- Where there is more than one tattle 


in the base chains 2 Line summarizing the total rueber of entries 
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in the chain follows the last table of the chain. This sum 


includes the final osegqa entry. 


The tabie cata printcut its similar to that fcr index sequential 
structures» consisting of key/address pairs» as many per line as 
fits. The tast entry of each base chain is supposed to be an 
cmega entry Calt aFas)» end an error is reported if it is missing 
Cerror numter 33). This entry is atso printed» appezgring as 
CL-omega-}}]. A nuti entry in any other piace shows as question 
markse Following each tine of entries» any errors occurring in 
the entries are reported. These include errors concerning the 
keys Cerror rumbers 29» 305 and 32)» and errors concerning thre 
edoeresses (error mumter 17). Extended validity errors Cerror 
runbers 41 and 42) ard circuiar table pointers Cerror number 7) 


ére reportec as for incer sequentiai structures. 


Fopudaticn Suaear y 


The poputation summary censists of two parts. The first part is 
frinted fer structures with the NAHL COUNT option set. The 
second part is printed ordy for structures that have the VALIDITY 
option set. The first pert telis how many tables or reccrds have 
teen openece This is cetermined from the hichest open CHO)» and 
if the HC is bad» zero records are considered open. The count of 
tables or records on the NAHO chain is reportec and the resulting 
population computed trom these two numbers is printed. If an 
error was encounterec tn processing the NAHD chains then the 


population is reported at meaningless. If the file nas missine 
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then no popudation cen be reported. 


The second portion centains statistics accumutated while 
processing the structure during validity checking» and is 


cifferent for each structure. 


Cisjoint Data Set (005) Population 


Counts of cead and active records encountered white reading 
sequentialtiy through a disjoint cata set ére maintzined. These 
counts are printed ifr the population summary. The total dead 
records seen should te tte seme as the numter on the availabie 
chaine If this 18 nct trues error number 93 is reported. If the 
extended validity checkirg is performed on the disjoint cata set» 
the gctual number of recerds which appeared dead but were not on 
the awailatle chain ere grinted. The total active records seen 
sheuld be the same as the population coaputed from the 
nextravaidable ano highest~open C(NAHO). Error number 1 is 
reported if this is rot true. If the NAHC chain was bad» this 
check cannot be made and an appropriate message is printed to 


inform the operator. 
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Eabedded Structure (ES) Population 


The number of active tables encountered» and the total number of 
entries they contained» is printed. The total number cf tables 
must equat the expectec roputation terror number 1)-2 The numter 
cf tabies that are required after a generate operation (8 
GENERATE CrS/ODASCL compiler option) is aiso printed. This is 
cetermined by considerine the minimum space required to house git 
the entries of each fparert. Sumsaries by parent record include: 
number of parents with nwtd fists? number of entries for the 
parent that had the aost entriess number of entries for the 
parent that hac the feweet entries Cexctuding fast subsets and 
nuld tists)? and» fer urordered manual subsets» the number of 
farents with fast sutsets. If the parent data set file was 


missings then this stimmary cannot be given. 


Incex Sequentiaid CIDXSEQ) Poputation 


The totad number of active tables and entries is printed and 
checked» as is dene for embedded structures» The tatle and entry 
counts are then broken dewn ty table type: high level coarse 
tables» low level cozerse tables» and fine tables. The tast 
C(nuttl) fine table entry is not counted as an entry heres» so the 
totad nuaber of fine table entries shoutd equal the object 
cisjcint data set Cerror number 15) for sets. For subsets» the 
fine tabde entry court stould not be greater than the disjoint 
data set population ferrcr number to). Checks cannot te made 


agzinst the object cisjoint data set population if the object 
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cisjaoint data set cic not have its NAHO COUNT option set» or if 
its NAHO chain was bid. In such a case» a message ist printed 


tedding cf the omission cf this check. 


Incex Random CIODXRND) Fopulation 


The total rusber of tables and entries is printed and checked» as 
is done for incex secuential structures» Then the table and 
entry counts are broken cown by base tabtie and overfiow tables. 
The cmega entries are not inctuded in these entry counts. The 
total number of entries thouid be equat to the object cisjoint 
cata set pcpulation (errcr nuaber 15). As for index sequentiat 
CIUXSEG) structures» no check can be made against the object 


cisjcint data set pogutation if it is unavailable. 


Evror Susaary 


At the end of att DMS/DBWAP Listings is an error summary 
contzining the data base name and the totat number of errors and 
karnings. AS sone errort can be encountered in the KA summary» 
any CMS/CERAP run car hawe some errors. <Acditiornal errors are 
encounterec in the NAKG tount operation. Most errors» of courses 
are encounterec in the velidity checking cperation. Fecllowing 
the totais» a breakdown is made by structure. For each structure 
Raving any errers or warrings» the structure number» name anc 
error anc warning counts are printed. Key comparison errors for 
manual subset or incex structures are attributed to the manuat 


subset or index ard rot to the object disjcint data set. Errors 
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in a listhead are attribated to the parent recorc containing the 


listhead»s and not to the embedded to which the tisthead refers. 
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Ervor» Warnings and Abort Messages 


The fottowing paragraphs describe the error» warning» and abort 


aessages fcr the DMS/DEMFP program 


Error and Harning Kesszges 


Att error and warning metsages produced by the DMS/DBMAP crogrém 
ere listec atphabeticaity on the foitowinc pezges. Warning 
messages occur for situations that can legitimately occur Cut 
which shovid be troucht to the user*s attentione Errors are 
ftlagged for situations which must not occurs they are the resutt 
cf cerruption. Their effects on the system vary in severity. 
Fost of these errors procuce either an integrity error from OMS» 


or resudit in the fetchine of wrong records. 


A message is displayed fer the first error or warnings» to tet the 
cpersztor know that the listing must be examined. The total 
rumrber of errors Cbut not warnings) ts inctudec in the end-of-job 


CECJ) statement. 


In the printer listirg» if the print option is set» error anc 


warning messages appear 2s follows: 


#a ERROR *«* <tept> or * WARNING * <text> 
or» if the print opttcn 18 not set» as 


**@ EREFOR «*« (Str# <number>) «text> or 
* WARNING «* (Str# <number>) <text> 
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For some errorss those ir index tables for instances the error 
fire is preceded by zz tire containing a string of #484 characters 


uncerneath the fiele causing the problem. 


Error List 


In the pages that fotlouws the number to the teft of each error 
message identifies tke error number. The number does not appear 
with the error in the DMS/DBMAP Line printer output. The code 
CK} or (NK) or (CV) of CP) following the messace indicates whether 
the error is repcrtec auring the KA» NAHO COUNT» VALIDITY» or 
POFULATICN SUMPARY operations.- ¢¥ and P errors are reportea onty 
if the VALIDITY opticn if set for the retevant structure. The 
structure types for shict each error can te reported are enctosed 


in square tractets. 


S3 ABNCRPAL STATUS IN CATA BASE GLOBALS 


CK) LALL] Cwarning) 


One or more of the etbnormal status flags is set in the data 
base globais. Whis warning foditlows the heading tox that 
prints the filagse (C{ften» when one of these flags is set» 
integrity errors car be expected in the data base» but the 


DMS/TEMAP progréem weps atl structures anyway. 
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1 ACTIVE RECCRE CCUNY CIFFERS FROM NAHO POPULATION 


CP) ¢Ct03i 


The NAHC poputations cdeterminea by subtracting the number of 
recorcs found or the avaitable chain from the numter of open 
recorcss ciffers frem the actual numter of live receras seen 
when reading the cisjoint data set sequentiaity. This 
difference can cccur if there is a Live record on the 
available chaine which is reported with error number 327» or 
if there is a dead record not on the gveitabie chains which 
is to be reported with error 8 if the eatendec vaticity 


option is set fcr tte disjoint data set. 
2 ACTIVE TABLE COULAT DIFFERS FROM NAHOQ POPULATION 


CP) CICX»EDS »MS2] 


Error number 2 is atite similar to error nuaber il» except it 
refers to index and embedded structures. The numter of 
tables actuazily enccuntered while reacing the structure 
differs from the NAFO population. This difference can occur 
if there is a live (entry count greater than zero) table on 
the available ckhain» which is reported with error numter 8» 
or if chains of tables intersect» which is tikely ta cause 


errors in ordering. 
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3 AUDIT AUFMBER: <rumberi> > GLOBAL AUDIT NUMBER: <number2z> 


Cv) CIOX-ES] 


For an aucited cata base» an index or eabedded structure 
biock was found in ohick the audit number <numberi> was 
greater than the aucit number in the OMS giobais <numter2>. 
For esbedced structtres» this is reported every time ¢ tattle 


from the bad bOlceck Is read. 
4 AVAILAGLE CHAIN IS CIRCULAR 


CN) TALL] 


More records have been found on the availabte chain than 
have ever been cpenedj There is no indication of the point 
at which the chain vent tad» when this error occurs» no 
NAHC popuiation can be computed and some poputation checks 


cannot be meade. 


5 CAN*Y CPEN FILE FOR <str name> FOR EXTENDED VALIDITY CHECK 


C¥) ©PS5e1IDX) Cearning) 


The file for the object disjoint data set <str name)» neeced 
to perfora exterded validity checking for a manual sutset or 
index structures cottd not be opened. tTherefores the 
extenced validity cteck coutd not be aace» ana a regutar 


validity check is mzde instead. 
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6 CAN*T CPEN FILE FOR «str name> FOR NAHO COUNT 


CN) CCOS*EDSoMSS>1IDII Cwarningds 


The file for structure <str name> could not be cpened and so 
the requested N@HO COUNT options as well as any validity 


checking» could not be performed on this structure. 


? CIRCLLAR TABLE PCINTERS 


C¥) CEDSshSSeITOXSEQeTIDXRNDI 


While processing an index or manual subset structures more 
tabdes were seer then were ever openede No indication is 
given of where the tabte pointers went circular. Usuaity» 
quantities of other errors (key ordering» wrong next 
pointers» and sc forth) are reported before this error 
occurse This error is more an escape for the DMaS/DEMAP 


progrza that an integrity error in itself. 


68 CEAD RECGRO NOT IN ANAILABLE CHAIN 


€v) €£05) 


A disjoint cata set record containing a dead flag was net in 
the avaitlabte crain for this disjoint data set structure. 
The recorc 1$ written out preceding this error (normally 
dead records are not written out). This error is reportec 
only if the extencec vatidity option is requested on this 
disjoint cata s€te Making this check can require extra 


wirtual disk» Feter to Execution Examptes in this section 
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for acditioral information. 
9 *«number> DEAC RECORDS NOT FOUND ON AWAILABLE CHAIN 
«{P) (C05) 


When reading a cisjcint data set sequentially» <number> more 
dead records were read than were founo on the available 
chain. If the exterded validity option is requestec on this 
disjoint cata set» then error number 8 is reported for each 


such record. 
10 EwPTY BASE TABLE DOES NOT CONTAIN NULL ENTRY 
C¥) LIDXRADI 


Index rancoa files tre initialized with an omega Cadi aFas) 
entry ir. €ach bese tabte. Error number 10 occurs if the 
base tabte has cnty one entry and no overflow tebles» and 
that one entry is net the omega entry. This does not hincer 


the use of the cata base. 
11 ENTRY CCUAT = 0 IS INVALID 
C¥) TEDS»*SS»IDX) 


An active table has an entry count of zero. This 15 an 
errer because enpty tabtes should be put tack on the 
available chains but this error does not affect proper use 


of the data hbase. 


1152444 11-46 01/19/84 


i2 ENTRY COUAT DIFFERS FROM OBJECT ODS POPULATIONS <numter> 
CP) CIDXRAODI 


The sum of att (non-omega) entries in a index random 
CICUXRND) structure wust be equal to the population of the 
disjoint cata set it spzense- The disjoint data set 
population that is compared is <number> and is the NAKO 
poputation tor that structure. Refer to error numbers 15 


and 16» aisoe 
13 ENTRY OUT CF ORLER IN TABLES <address>. LAST KEY: <key> 
Cv) CEOSCsimpde} 611290001 


In an ordered enbedced data Set» an entry in the table at 
*address> is out of order with respect to the prior key 
€key>. The key in error is printed just above this error. 
The acdress is incttded here onty to help tocate the key in 
error in case the print option was not set ana 60 Lines wés 
not sufficient to irctude the tabte header. (refer to error 


nueber 32s aisoj. 
14 FILE vISSING 
CK) CALL] Cwarning) 


The fite for a cata base structure is not present when the 
data kase is mapped.» Possibly» the disk pack for the file 
is rot on tinee If the file is also required for the NAHC 


COUATS options or as an object structure needed fer an 
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exterced valiaity ctecks» then warning numbers 5 or 6 are 


generated. 


15 FINE TABLE ENTRY COUNT OFFERS FROM CBJECT 


DOS pepulation: <nember> 


CP) CICXSES set] 


The sum of att fine table entries Cexcluding the final nuil 
entry) cf a sparnine index sequential set shoulca equal the 
population of the cgisjoint data set that it spans. The 
disjoint data set peputation <number> used for comparison is 
the AAHC population. Refer to error numbers 12 and 16>» 


aiso. 


16 FINE TABLE ENTRY CO&NT GREATER THAN OBJECT 


DDS population? <nember> 


(CP) CIOXSEQ subset] 


For an incex secuentiat CIDXSEuw) subset» the sum of fine 
table entries sist rot te targer than the NAHC poputation 
€nuster> of its object disjoint data sete. Refer to error 


numbers 12 and 15» ztso- 


17 IN ADORESS* <acdress> CINVALILD DISK AREA NUMBER) 
CBEYCANC HIGHEST OPES) CINVALIO RECORD NUMBER) 


CINVALTIC ELCCK CFFSET) 
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Ceveryuhere) TAtLI 


This error can cccur tir many paaces whenever a nen format 
address appears in @ structures. Sometigxes an acditional 
error messages tor examples INVALID NEXT POINTER» is 
generated. Addresses are checked in several wayse If the 
address faits any of the checks» then this error occurs and 
the approgriate parenthesized message(s) is printed. Refer 


to error numbers 18 and 47» atso. 


CInvatid cisk area rumber): the area numcter in the address 


is greater than the number of areas allocated to the file. 


CBeyond highest oper): aithough the area number is within 
the file» the acdrets is beyond Cor ecuat to) the highest 


openec adcress gaintained in the dictionary. 


CIinvatlid record nuster)d: the record nusber in the sddress 
is greater than Cor equét to} the maximum number of recorcs 


per ttock for this ttructure. 


{Invatiac bicck cffset)> the block offset in the address is 
greater than Cor eatal to) the maxinunm nuaber of blocks per 
area times the rumber of segments per blocks or the block 


offset is net a muttiple of segments per btock. 
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18 IN NAHKG2 <address> CADDRESS IS NULL) 
CINVALTO CISK AFEA #UMBER) CBEYOUND HIGHEST OPEN) 


CENVALIC FECORC NUMEER) CINVALAD BLOCK OFFSET) 
CK) CALL] 


This error is very wuch tike error number 17» except it can 
onty be reportec when checking the next available (NA) anc 
highest ogen CHC) fietd in the KA phase. The restrictions 
on the NA and HC fietds are stightly different than the 
restrictions on norwat addresses» Tre NA or HO fields can 
be equai to the highest opens In an HO fields» or in an NA 
field that is ecuat to the HO fietd cof any of the fietds» 
recorc»s biock or area» can be equal to» but cannot exceed» 


the maximum. 


CADDRESS 15 NULL): for a NA or HO fieid» a nuit address 


Cati aFas) is net vzlid. 


47 IN OLD ADCRESS: <acdress> CFILLER BIT SET) 
CINVALID CISK AFEA PUMBER) CBEYOND HIGHEST OPEN) 


CINVALTIC FECGRE NUMEER)D CINVALID BLOCK OFFSET) 
CK > 


This error i8 simiter to error number 17» except the address 
being checked ts an oid format address. The restrictions 
are the same as for a new address» with the acditior of the 


fitdter bit checks 
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CFILLER BIT SET}: the fitter bit Chightorder bit of the 


block offset portior) is set» It must be zero. 
52 INTEGRITY“EFRCR FLAC IS SET 
CK) CALL? Cwarning) 


An integrity error tas cccurreda in this structure. The 
OmMSII system precesves the structure anyway and the 


DMS/DEMAP progrzm meeps tt as usual. 
19 INVALIO NAHC Lib IP <address>» ABORTING NAHO SEARCH 
CN) CALL €04710C€0] 


In the avaitabte tattle at <address>» the next availabie 
pointer is an invatid address. An address error Cerror 
number 17) precedes this error. The NAHO poputgtion cannot 
be oktained for thit structures, therefore» same population 


checks cannot be mace. 
20 INWALID NEXT ACCRESS 
CV) TIOXRNDI 


The next address pointer in an index random CIDXRND) tabte 
is @n invatid écdreese This error fottows an address error 


Lerror runsber 17). 
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21 INVALID NEXT PCINTEF. EXPECTEL <address> 


Cv) CIOXSEQ] 


The next pointes in an index random CIDXSEQ) table is not 
the same as the address in the adjacent parent entry 
<adogress>. wher this occurse the rightwrost coarse cr fine 
address in this table cannot have its next pointer checkec» 


and a message is given stating this error. 


22 INVALID NUMEER CF EP TRIES =~ USES <number> 


CV) CECS>KSS»IC¥] 


The entry count in @n incex or embedded structure tabie is 
greater than the madimue entries per table. For printing 


and checking purposes»s this maximum <number> is usec. 


23 INVALIC PARENT TYPE? <number> 


Cv) CIDASEOQ] 


The type table encotntered in an index sequential CIBDXSEQ) 


tabte was not véelide 


24 INVALIG PRICR PCINTER. EXPECTED «address> 


C¥) CEDSs SS eT DXSEO sTDXRNDI 


Embedaed structure tables are processed by following next 
pointers.» Therefore» the prios pointer in a tahbie must te 
the <address> of the tatle just reads if it 15 net» this 


error is generatece 
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An index sequential CIDXSEQ) structure» the prior pcinter 
must te the same as the address in the entry just prior to 
the parent entry for this table (simitar to error nuater 
212. When this errer occurs for an index sequertial 
CIODXSEQ) structires» the first key of the tabite cannot be 
checked for dupticates or ordering» nor can the tabie 


weached by the first entry have its prior pointer checked. 


For an incex rardom CIOXRND) structures the prior pointer of 
any tabte must te tte hbase tabie of that chain> if it is 


not» this error is cenerated. 
25 INWALIO SELF ACCRESS IN TAIL? <address> 
Cv) CIOXI 


The tait cf each incex CIDX) table contains the address of 
that table. This error occurs when the <address> in the 


taid ciffers frem the actuai aadress of the table. 
26 INWALIC STRUCTURE NUMBER IN TAAL? <num ter > 
Cv) £10x1 


The taii cf each 10) tabie contains the structure nusatber cf 
that IDX structtre. This error occurs uahen the structure 


Cnusber> in the tail is wrong. 
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27 INVALID TAIL <acdri> FOR EMBEDLED <str name> IN RECORD 
<adcr2> 


EXPECTEC «acdress> 
CV) LEDS»*S5S) 


[In the structure hezd for embeaded <str name> in the parert 
record at <addrz>» the tail <agdri> differed from the actual 
address of the dast table in the chaine The tast table is 
reccqrizea by havine a nuild next pointer. Because this 
error foattous the printout of ali entries in the chain for 
this embecded structures the parent record and takie head 
cannot be inctucec in the tast 60 lines Cwhen no print 
sptieu ie set)» and so the parent address and offending tait 


address are repeatect tn the error text. 
28 INVALID TYPE <nember 1>.2 EXPELTED «number 2> 
CV) CIDXSEQ>ICXENDI 


For an incex secuentiat CIDOXSEQ) tabte» the atlowabte types 
<nugscker 2>» are determined by the type of the parent table 
number 1>. The takie keading giving the bad type 
immediately precedet this error. then en index sequentiat 
CIXSEG) table has a bad types no attempt ts made to access 
tables to which its entries point since it is unknown what 
structure (the index or its disjoint data set) they refer 
tow A message is given stating this error. For an index 
rancom CICXKND) stracture» adil tabtes must have a type of 
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29 KEY IN WRONG BASE T@BLEj SHOULD BE IN <address> 
CV) CIDXRNDI 


The vatue of the key Cthe particular key is pointed out with 
### characters) places it in a different base table Cor 
overflon table) thar the one it belongs in» It must be tn 


the tabde at <acdress>. 
30 KEY IS INVALID CUPLICATE 
CV) CEDS»eSS eI DXSER »sIOXRND 3 


In ar ordered structure where oupticates are not attoweds a 
dupticate key hes been found. For incex CIDX) structures 
the key ir the preceding line is pointed cut with a string 
of ###@ characters. For embedded structures» the cupticate 


key is the cne in tte ismediately preceding entry. 
31 WEY IS Toc HEIGH FCR THIS TABLE} MAX IS <key> 
CV) LTIDXSEQ] 


In an index sequentiat CIOXSEQ) tabie»r no key must be 
greater than the key in the parent entry that pointed to 
this table. The parent key is <key> and the offending key 
in this tabie is identified in the preceding tine with 448 


characters 
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32 KEY CLT OF CROEF IN TABLES <aadress>.~ PRICGR KEY: <key> 
CV) CEDSCcoaptes)»MtS-ICXSEQ-ITOXRND] 


Within the table of an ordered structure» a key is not in 
order. In embecded structuress the entries are maintainec 
in key orcer within each chain of tables of eack parent 
recorce. In an index sequentiad CIDXSEQ) structures att keys 
at one level must be in order. In an index random CIOXRNE) 
Structure. alt key? in the base table chain must be in 
order. The precedirg key to which this key is compared is 
<key>. For index C1IDX) structures the key in the preceding 
tine is icentified with 448 characters. For emtedded 
structures» the key is the one tn the immediately preceding 
entry. This error is retated to error nusber 1: for 


embeccec structures. 
33 LAST ENTRY CF CHAIN SHOULD BE A NULL 
CV) CIOXRNDI 


The tast entry cf a base table chain must be a nutl omega 


entry Calt aFas)}. 
34 LAST ENTRY CN LEVEL SHOULD HAVE NULL KEY 


Cv) CIOXSEQ] 
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The tast entry cn ezch tevel of an index sequentiat CIDXSEQ) 


Structure must Fave a nuti Catia aFas) key. 


35 LAST FINE TABLE ENTFY SHOULD BE NULL 


Cv) TIDXSEOQ]I 


The last entry in tte fast fine table must be entirely nuit 


with all @Fas fer beth its key and address. 


36 NEXT LINK IS SELF CEDS»MS5) 


(wv) CEBS»¥55) 


The next pointer in an embeddeao structure table is the sae 


as the adcress cf tte tables» making 4 stort circutar tist. 


37 NON“CEAQ RECORE IN PEXT AVAILABLE CHAIN AT <address> 


(CN) (C033 


Ati records in the evailable cnain cf a disjoint data set 
must have dead tlagse. This error message is generated if 
the avaitable recorc at “<adcress> is not dead. The actual 
recorc car te seen if the data for the structure is printed 


out. 
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38 NONEMPTY TABLE IN EXT AVATLAELE CHAIN AT <address> 
CN) CECSeeSSs IDX] 


Atti tables on the available chain for an index CIDX) or 
embecced structure sust have zero entry counts. This error 


occurs when the avaiiable table at <acdress> is not dead. 
41 QDBJECT FECORD If CED 
Cv) CeSSCHss) CvearningI»MSS Cwarning Jo LDXSE Qs IDXRND ) 


This error messzge is only generated if the manual subset or 
index CIDX) structure has the LXTENDED WALIDITY option set. 
The error messa¢ce occurs when the disjoint data set recorc 
pointed to from the index (IDX) or manual subset has a dead 
flag set. For indes structures this is an integrity error» 
but for manual subsets it is only a warnings as nothing 
preverts 2 program from deteting a record pointed toca from an 


manuai subset. 
4&9 RECCVERY~IN-PRCCESS FLAG IS SET 
CK) CALL] Cnarning) 


The FECOVERY*IN“PROCESS flag is set in the file recorc. 
This is normatty onty set in memory during recovery and 


shouic not be set ir the dictionary. 
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51 REORGANIZATIOGN-IN-PFOCESS FLAG IS SET 


CK) CALL] Cwarning) 


The REQRGANIZATION~“IN“PROCESS tiag is erroneously set in the 


file recorde This YTlaq must not be set. 


42 TABLE KEY ~ OBJECT FEY MISMATCH. OBJECT RECORD CONTAINS = 


<key> 


C¥) CSS Cwarningds IDXSEQ>s IDXRNDI 


This error messzge is generatea if the manuat subset or 
index C104) strecture has the EXTENDED VALIDITY opticn set. 
The error messace occurs when the <key> in the disjoint data 
set recorca at ar aderess pointed to from an manuat subset or 
index C10X) structurer differs from the key with that 
address in the wanuzl subset of index CIDX) table. For 
index CIDX) stracturess this is an integrity errors but fer 
manuat sutsets» it is onty a warning message» as nothing 
preverts a prograg trom changing data in a record pcecinted to 


by en MSS entry. Refer to error number 43% also. 


43 TABLE KEY ~ TABLE D?#TA MISMATCH. DATA CONTAINSS <key> 


Cv) CEOS! 


In ar ordered eabeacced data set with a comptex key» the key 
composed from the deta is stored separatety in the tabte. 
This error cccurs if the separately stored key differs from 


the <key> withir the datae The keys in the date anc in the 
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tabie are printed with the previousty printed entry. Refer 


to error number 42» also. 
48 UPDATE FLAG I5 SET 
CK) CALL] Cwarning) 


The updating fleg tif set in the fite record for a structure. 
This file was being updsted when the system hatted. 


Reccvery is reaqurirece 
45 VERSION MISMATCH. VERSION ON DISK I8 <version> 
CK) CALL] 


The file version in the dictionary differs from the 
<version> in the citk file heaaer for a OMSII structure 
file. This does prevent the structure from being used ty a 
program. The DO*S/DEMAP prograa opens the file for validity 


checking anywaye 
£0 WRITETERRCR FLAG [5S SET 
CK) TALL Crarning) 


The WRITE“ERRGR flac is set in the file records indicatine 
that an output error has occurred on the file. The CmsSII 
system does not aticw use of this file. The OMS/C BMAP 


program maps it anytays 
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46 ZERC ADORESS FCF AREA <number> 
Cv) CALL] 


Area <number> fcr tke file has a zero address in the disk 
file header. When this occurs the file is marked as missing 
internally within the DMS/DAMAP program so that no attempt 
is mace to read ite Subsequent CAN*T OPEN FILE warning 


messages result. 


1152444 11-61 01/19/84 


Abort Messages 


Abort Messages are not dtta base integrity errors» but errors 
that make it inmpessitie for the OMS/DBMAP program to continue 
cperation. They are flacged as errors in the output printer 
listing anc gre atiso disrlayed at the ODT. They always result in 
aomeswory dugp being taker and the DMS/DBMAP program being 


stoppede 


There are two general rezsons for aborting a DBMAP rune Either 
the program has encotntetred some internad errors for example 
attempting to read a file which has been openec once successfully 
but iS now missings ofr en attempt has teen svade to run the TBrAP 
program uncer conditions which it cannot te run Cfor exaaples 
khen the data tase 18s opened updates» The abort messages in tte 
fottowing tist are icentified as one of the two types. For akort 
aessages of the first tyre» if the operator can think of no 
rezson for the abort Cif» for exampde» the file has not teen 
removed» then a Fietc Conmunication Form shoutc be submitted 
zetong with the dusp end ~s much of the tine printer file as has 


teen made to ycur Burrouchs representative. 


The following are the abcert messages. 
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CAN OASLY MAP 11.0 CATAEASES 
The data base specified is not a Mark 11.0 data base. The 
DMS/CEMAP progréem mzps Mark 11.0 data bases ontye If the 
data base is to be used with the Mark 11.0 operating systems 


it must be convertec using the % CONVERT option. 


CANNOT MAP ACTIVE LATAEASE 
The dictionary fite is tocked» indicating that it is 
currertly openec upcater presumably ty the OMSTI system. 
The UPS/DEMAP progrem can access this data base when the 
data base is no loncer opened update. This is en atort of 
the seconc Cuser) type and can occur frequentty if OMSII 


programs access the data base. 


CANNOT MAP DATABASE WITH ACTIVE FiLEs <fitename> 
Aithough the dictiorary was not open update» some file 
required for a AAHD count Cor validity check) is open 
update. The OMSE/CDBVAP program cannot run until any programs 
updating the dictiorary files are finisted. This is an 
abort of the second Cuser) type =" no TR shouid te 


submitted. 
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“CAN*®T OPEN FILE FOR «<str#>3 <str nase>* 


The file for <str nane> tas successfully been opened orcer but 
later» when trying tc reed it» it is found to be missing. 

Because the CMS/CBMAF pregram may need to switch between files» 
the fite fcr a structure can be opened» closed and reopened. if 
it has been opened seccessfully oncese the DMS/DBMAP ocrogram 
expects it to resain pretents» aithough it ts possible for somecne 
to remove it during its closed periode If this tas teen done 
then this is an abort of the second types Hawevers» if the file 
is present then this is en abort of the first type. Contact your 


Eurroughs representative for assistance. 


CAN*T FEAD DICTIONARY FILE HEADER 
Although the dictiorary fite has already been opened and 
reac»s later its file header cannot be reade This is an 
abort of the first type and your Burrecuchs representative 


Should be contacted« 


CATABASE DICTICNAFY? <«titte> IS MISSING 
The dictionary tor the data base nawmec ty the user Ceither 
in the coamand strirg» or in a compite statement) its not 
present. If the <title> is the one specified by the user 
and if the file actratly is missing» then this is an abort 
of the second (tser) type. if the <title> is not the one 
specified by the user» then this is an abort of the first 


type~e Contact your Burroughs representative for assistance. 


1152444 11-64 01/19/84 


ERROR IN COMPAND FILE. <msg>» SECINGS <last thing read> 
If the ccamands are read from a file» then any commanc error 
causes an abort as «escribed in the paragraphs entitied 
Coesand Errors in ttis section. The acceptable syntax anc 
possible error aesseges are described in the paragraphs 
entitded Coemancs ir this section. This is an abort of the 
seconc Cuser) type» untess the complaint in <msg> seems 


invalid. 


ERFOR IN SET OPTIGA 
This is an internal error in the command parsing routines. 
[t gust net be gossible. In order to centinue processing» 
try aitering the syrtax of the commands» or using different 


commands. It it an abort of the first type. Contact your 


Burroughs respresentative for assistance. 


ILLEGAL VALIC_NAHO CALL <string> 
This is an internat error in the adoress checking routines. 
Theoreticatty» it stould not be possitte. I[t is an abort of 
the first type end your Burroughs representative should be 


contacted. 


FEAD ECF OF FILE Fe#>2 <filename> AT ADDRESS <address> 
An attempt has reen made to read a OMS file <filename>» 
which is switch file nuaber <#>. <adcress> is the new 
format OMS togical ¢ddress causing the error. #8ecause ait 
addresses are checked for valiagity before use by the read 
routines this is an error. This is an ebort of the first 


type and yotr Brrrotghs representative should be contactec. 


1152444 11-65 01/19/84 


APPENDIX A 
O*S/DASDL GLOSSARY 


The fottowing cefinitions are intended to give a working 


cescription of the terms used in this manual. 


ACCESS 


4 method to reach a desired record of a data sete 


COATENTICN 
A conciticn in shict a program is attempting to access 2a 
tabde entry or fogicat record within 2 physical biock which 
has atreacy beer tocked by another user. If the program 
waits for access to the block tor more than MAXWAIT seccncs» 
it receives a CEACLC(CK exception. Reter to DEACLY EMBRACE 


for accitional information. 


CEADLY EWBRACE 
A conciticn in shict a chain otf programs existss each of 
which is waiting for CONTENTION to be resotved on a block 
white simudtanecusty having tocked a btock which another 
program in the chair is watting for. Upon recc¢nizing a 
DEACLY EMERACE, the DMSII system returns a DEADLOCK 
exception to the tosest priority procram in the chain and 


untocks ail reccrds tocked by that program. 
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CISJOINT 
The ccnditicn cf norsreliance of data sets an the highest 
level» that is» a deta set which is not an item within a 
data set. Stancard data sets» sets» ano automatic subsets 
are the only structures that are disjoint. Cisjoint sets 


can only refer to disjoint data sets. 


EMBEDDEL 
The condition of being dependent on 2a deta set thet is on a 
higher tevels that is» a data set which is an item within a 
data set» An enbecced data set can onty be referenced by an 


embecdced set on the same ievel. 


INCEX 
A table cf pointers to a data set used to provide specified 


access to a date set. 


INNER LEVEL 


see ErPBEDCEC. 


MASTER 
A data set record which has dependent data sets is referred 
to as either the masters» parent» or ouner of the records of 
the depencent céetae sete A master may itself te a record in 
an embecded datz sete An embedded data set cannot te 


accessed without accessing the master. 
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PEMBER 
An cecurrence of a record of a data set 15 a member cf thst 


data sete 


CROEREC 
Maintained in 2 sequence depending on tte vatue of user 


specified fielcs based on a codtatina Sequence. 


CWAER 


see MASTER. 


FAFENT 


See MASTER. 


FATH 
An access to a cata set record. Qne instance 18 é@ path. A 


set 15 an index of raths. 


FOPULATICN 
The number of recorecs in a data sete Fer an emtecdec daté 
set» the popuiation is the number of records in the embedced 


data set per occurrence of the master data set. 


FRCPERTIES 
The physical structtre and parameters of a data set» set» or 


subset» such as storage requirements or structure type. 
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RECORD 


A recorc contairs all the information that pertains to an 


entity. 


SCOPE 


The range of influerce of a data set» set» or subset. 


SEI 
An incex cf paths tc a data set with a pointer to each 


recorc of that cata set. 


SPAN 
An incex»s whether ordered or retrieval» which references 
every recora in a deta set is said to span the data set. 
Subsets» whether automatic or manuads mcy span 4 data set» 


aithough typicattly they are not spanning sets. 


SPLITTIACE 
The methoc of irserting a new table into a set. hhen 
fidiecs OvwSII sclits an index table intc two tables rather 


than usine overflow techniques. 


SUBSET 
A codidtection of patts to some or att of the records of a 
data set. Ihe criterion for membership in the subset can be 
specified te the D¥S/D0ASDL compiler through a WHERE clause» 
in which case the stbset 185 automatic and maintsined throtgh 
an incex structure. Aitternativelys» reccrdas can be 


programmaticaitiy inserted into the subrset» in which case it 
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1s a manuat subset ence is maintained by means of a2 tist 


structure. 


UNCRDEREL 


Not maintained in a user specitied order. 
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APPENDIX 6 


EMS/TASDL GENERATED CODE 


The CMS/CASOL compiler generates coae to perform the following 


furctions: 


VERSION ANC SECURITY CHECKING 


These functions are cerfermed by the operating system (MCPIT) 
whenever a procram issues a CMSIL operation» This code yalidates 
any ftogicad data base nane included in the open operations checks 
the version stamps of ai structures inctucedc in the path 
cictionary of the precgrass and ensures that the user program 
weets any security requirements that are specified through use of 


é SECURITYCUARCL file. 


KEY“BUILDIKG CODE 


This code is calied shenever the OMSIT system needs to construct 
the key for any structure which has key items dectared Cincexec 


set cr sutsete» or orcerec tist). 
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WHERE» WERIFY> AND REQUIRET CLAUSE CHECKING. 


Each time an update cperzetion is performed on &@ data set recorca 
(store operation after either a tock or create operation)» the 
CwS/TASCL-qenerated coce is executec to tirst evaluate any VERIFY 
or REQUIRFEC ctauses (for both the fixed anc variable format 
parts). If any of these checks fati» a DATAERROR DMSTATUS 
exception condition is generated. af a store operation was 
éttemotec after a tock oreratione the DMS/DASDL-generated code is 
then used to déetermire if any critical fields (those data items 
which are used in KEY or WHERE clauses) have changeds if not» 
the STORE is triviat. Id any of the critical fietds has changed» 
cr if it is a stere cperztion following a create operaticn» each 


set and automatic sutset must be examined in turn. 


For a store cperatior following a create operations the EMS/CASOL 
coce evatuates all of the WHERE ctiauses on automatic subsets. If 
the record satisfies any of these ciauses» the recore is inserted 
into the @cpropriate subtrets tn addition to zlt of the sets 
ceclared for the date sete. The OMS/DASOL~cenerated key buitding 
coce is called during the insertion of the data set record intc 


these sets and subsets. 


For 3a store operatior foltowing a lock operation» all sets and 
sutsets ere examined to cetermine tt the key has changed. If it 
has» and the change 18 velid»s the old key is removed from the 
incex and the new key ts inserted. If the key has not changed» a 
KEYCRANGED DMSTATUS excertion condition is generated. In 


eaqcition tc checking for key changes» the WHERE clause for each 
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@utosatic subset is reevaluated. «af the vatue of that ccndition 
has changecs then the record is inserted into or removed from the 


subset. 


For embecced data sets» the process is identicai for both the 
store operation after a create operation and the store operaticn 


after a tock operaticns gith two exceptions: 


1. A WHERE clause canrot reference an embedded data set. 
Ze Key fietas for an erdered embedded daté set cannot te 
charged. 


For both disjoint anc emtedded data sets» the DMS/DASDL-generated 
coce is cniy used for the key building and fcr the various 
testing being perforaece None of the structure maintenance is 


performec ty this coce. 


ALL INAITTALIZATICN OF CATA ITEMS 


This code is executec each time a create operation is requestec 
by a usere Any item for which an INITIAL VALUE clause was 
specifiec receives ttat wailuee. The RECORD TYPE field» if 
gcresent» is initialized to the vatue suppliec with the create 
operztion. Att cther items are initialized to nults. If the 
varizbte format value surpiied with the CREATE CCOBOL and COBCL74 
cnty} vert does not watct any of the vatues ztlowea tor the 
RECORD TYPE fietds the O°S/OASDL~generated code returns a 


CATAERROR CMSTATUS exception condition. 
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For 6 recreate operation» no initiadization is performed» tut the 


FECGFD TYPE fietc is verified. 


SELECT CLAUSE VERIFICATION 


Any checking needed to sereen data set records from a remape» are 
specifiec by a SELECT cileusee This code is functionetly 
identicad to that used fer the WHERE and WERIFY clauses. If a 
record faiis to meet the specified conditions the OMSII system 
reprecesses the fina operation untiit a record can be found which 


satisfies the request. 


TRANSFCRMATICN CODE FOF REWAP RECORDS 


Transformation code constructs a rewap record trom the contents 
of a physical cata set record. The format of the renap records 
€$ presenteo to a user program» matches the ceciaration cf the 
remap» and is totalty incependent of the format of the physical 
cata set reccrde It the remap record exactly matches the 
physitcat data set record fas in the case of a remap used to 
assign RPGII~compatitle cata names to an existing data set)» nec 
transformation ts needed» [In ail other césese a transtormation 


gust be performec.e 
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TRANSFGRMATICN CODE FOF PHYSICAL DATA SET RECORDS 


Transformaticn cede recorstructs the physical data set record 
from the contents of a remape This code is the exact inverse cf 
thet used to ccnstruct tte remapre with the exception that att 
FEADCNLY ttems are simply verified» rather than movece as part of 


this reccnstruction process. 


COCE SEGMENT ASSIGNMENTS 


The cperating system (MCFII) assigns an entire code page to each 
cpen DMSII desta base.e. Ezch page can contain up to 64 individual 
segmentss there are six such pages reserved within the cperaeting 
system (MCPII) for OFSITT data bases. Wher generating coces the 
OMS/DASOL compiter attempts to Limit each code seqment to a 
length of 10240 bits (€12€0 bytes). If the arount of code 
required for the data bate cannot fit into 64 segments of this 
sizes then the size cf ezch segment is incremented by 1024 bits 


until 64 segwents can acromodate ali of the code. 
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SYSTEM/MARK“SEGS PROGRAM AND DMS/DASDL COMPILER 


If the CCCE cottar ogtior has been set in the DMS/DASDL compiler» 
then the OKS/DASGL tListirg describes the type and docation (hy 
segment number) of the cede generated for each structure. The 
SYSTEM/MARK@“SEGS procram attlonus the code segments» withir a data 
base dicticnary» to te merked as importants» for use with the 
Friority Memory Manacemert routines in the MCP. To use the 
SYSTEM/MAFK-SEES. procram for this purposes the key word OMS must 
te the first option specifiec to the program» followed by the 


rumbered tist of seguente to be marked. 


User discretior is acvised when marking segments. <A code segment 
which is usec infreaceently» such as the version checking code» 
sShcutd never be garked. Code segments to te marked shoutc onty 
include those that are related to highiy velatile cata sets anc 
ere retatec to the sets etna subsets which reference those data 


sets- 
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APPENOIX C 


COBOL QUALIFYCATION OF UMSET IDENTIFIERS 


Unique idertifiers are required in COBOL procrams. If a data set 
is invoked more than once» separate internal names must be used 


so that items within the daté set can be appropriately qualified. 


A variahbte deciaraticn with the same name as a data tase item can 


ke usea onty if the item is able to be uniquely qualified. 


In a selection expressiors sets and subsets require quatification 
if they are not tuniaue tcentifiers. Data tase items in a 


selection expression neec not be qualified. 
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Exampie 


CASDL: 


» 
* 


Di DATA SET( 
A KRUMBER (5) 
B NUMBER (€33)>3 


S1 SET CF O01 KEY A)» 


CCBOL: 


Ce 
01 
01 


DEASE. 
D1 INVOKE C1. 
CA INVOKE C1. 


WORK ING“STORAGE SECTICN. 
77 A FIC 994.¢€Invatlid tecause it cannot ce uniquely qualifiec.) 


01 @ 


03 A PIC 99. 


FFOCECURE OIVISIOA. 
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MOVE 
FIAC 
WOVE 
FINE 
FINC 


A CTF C1 10 Le. CValid.) 
CValid.) . 

A WO 4. (Insefficient quatification of A.) 

$1 AT A = Le CInsufficient qualification of S1.) 


$1 OF Di ATF = Le 


$1 OF DA AT #@ OF ODA 


= tLe 


INDEX SEQUENTIAL? 


(talic because it can te quatified.) 


CV¥atia tut A need net be cualifiec 


in a selection expression.) 


C2 
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APPENDIX D 


B 1000 - £ 67€0/8 7700 DMSIIT COMPATIBILITY 


The relaticnshiop of € 10f0 DMSII to B 6700/8 7700 D¥STI is as 


fottowss 
1. 6 1000 DPSIT is a togicad subset of 8 €700/8 7700 CeSII. 
Ze Any COBOL constructs used to access §& 1000 DMSII are 


Syntacticalty gnd temanticatty compatitle with 


8 6700/8 7700 EMSII. 


a6 Any chysicat dzta tases developed on the B 1000 CMSII are 


not coapatibte witt 8 6700/8 £700 forwats. 


4 The crcerec embedded data sets» together with its access set 
of B 1000 CMSTis is not supported ty B 6700/8 7700 CeSII. 
Howevers the icentical COBOL capability is providec ty 
gakirg an crdered embedded data set an unorcered embteddec 


data set together vith a set on 8B 6700/B 7700 OGmSII. 


5 The physicatl mappirg algorithas on the two systems differ 
significantty znd the ohystcat mapping parameters must be 
reviewed carefully prior to transfer from 8 1000 DsMSII to 


6 6700/8 7700 CMS). 
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Ordered and retriewal set types are not meanincful oan 
6 6700/8 7700 CMSI}s they produce ¢ reguitar 8 6700/8 7700 


DMSII sete 


DMS/TASDL paranetervs differ significantly with no cirect 
correspondence betveen 8B 1000 DMSITI and 8 6700/8 7709 


CsMS1di. 


8 1000 DRSIT hes ne structure comparable to the LINK in 

6 6700/8 7700 CMSTY. Howevers the FAST SUBSET mechanism 
Cunordered mantat tubset with only one entry)» described in 
Appendix 8» car be used to accompiish the same function és 


a LIAK. 


The generalizec selection expression as it exists in the 

6 6700/8 7700 CMSII has been implemented for use by COBCL74 
anc FPCII preoqrams which access a D¥RSII data hase» as welt 
as by the CwHS/INQUIRY program» This imptesentation is 
expdicitiy timited to these three scoftxare products» and 
preciuces any cf ttese products from using the partiat key 
search (refer to tte B 1000 Systems BMSTi Host Language 
Interface Manuzt). The generalized selection expression is 
valic for the COBROL74 compiter and not for the CCBCL 


compiier. CCBCL programs can use the partial key search. 


1152444 D-2 01/13784 


The foitowing CMS/CASDL end COBOL statements can be used to 
process ali of the recores of the set Si which satisfy the key 


condition: 


A = 100 AND € > @ ANT 8 < 500600 
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Examples: 


CASBOL: 
D1 DATA SET € 
A NUMBER{3 33 
—£ NUMBER(S )> 
$1 SET CF O01 WEY (AsB)I, INDEX SEQUENTIAL? 
CCBOL: 
PARA@A. 


FING S21 AT A = 100 AN’ B = 0 


ON EXCEPTION IF EMSTATUSCNOTFCUND) NEXT SENTENCE 


ELSE FERFORM <error-routine>. 
FERFOR*® PAFA-8 UNTIL aA > 100 OR B > 5000600 
PAFA"B. 


FIND NEXT £1 


CA EXCEPTION IF oMSTATUSCNOTFOUND) MOVE 101 TC A 


ELSE FERFORM <error~routine> 
ELSE IF A = 100 AND 8 NOT > 50000 THEN 2 e« « 


NOTE 


This taptewmentatior for partial keys exists onty in 
the 2B 1000 OUMSIi» end onty for index sequential 
structures Cautomatic subsets and ordered sets). In 
the — 6700/8 7700 imptementation of OMSII» the 
current fath pcirter for an index is not affected Ly 
an unsuccessful aperatione Therefore» the preceding 
coce dees not pfrodice the desired resuit on these 
systems» and users upgrading to 8 67004B 7700 OMSiT 
must modify any pregrams uhich use the preceding 
technique before ervecuting those programs on the 


£ 6700/8 7700 systems. 
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The technique cescribed in the prior example does not 
produce the desirec results in the B £1900 OMSII for 
either ordered manual subsets or ordered embedded 


data sets. 


Cata bases must be remaprec and reloaded at the time of transfer 
to 8 6700/E 7700 GMSI1I. Howevers any BDMSII statements in COBCL 
gregrams developed fcr 8 1000 OMSII are vatid on B 6700/E 7700 


CeSti» with the excerctior previously noted for partiazgt keys. 
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APPENDIX E 


CMSTY MENORY REQUIREMENTS 


The amount of semory reqtired to process a D¥SII data tase is & 
function of the complexity of the data base» as weil as the 
nature of the appticéetior being run against that data tase. For 
examples so very complex cata base containing many access methocs 
for each data set» as well as subsets between the data sets» 
recuires #uch gore memory to process than 4 very simple data tase 
contzining onty a fen access methods. Similarly» euch more 
meaary is required fcr urdating a data base than for inquiries 


into the same cata besee 


WORKING SET 


In acditior to the ccmpilexity of the data tase and the nature of 
the gpplication being perforaed» an extremely importent factor to 
he ccnsicered in the catculation of the memory requirec toa 
process a@ cata base is tte concept of workine set. hkorking set 
is defined to te the amotnt of memory which is neecea to perform 
@ precess sithcut causine thrashing Ccontinuadl overlaying of 
eemory to tring in the cede or data segments necessary). then 
the wemory available for a process is tess than the working set 
tor that process» througtput is drasticatty reduced. Threughprt 
improves as the smourt of mewory increasess the mest cramatic 
improvement is achieved Immediately after memory is increased 


teyond the working set Cthat amount of memory is often referrea 
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to as the thrashing coint). Catcudtations for the working set cf 


an application can te brcken down into code gnd cata components. 


WCPIIT MEMORY MAN@GEMENT ALEQRITHMS 


When MPFRI wCPIA opticn is set» the wemory priority and decay 
factor assignec to a DMSTI buffer are those of the user crogranr 


which has caused the bBufter to be attlocatecd. 


For @ore information on Friority Memory Management and the 
concept cf working set» refer to appendix A of the B 1000 Systems 


System Software Cperztior Guide» Votume 1. 


USER PROGRAM REQUIREMEARTS 


hithin a user gcrograas tte memory required consists of the code 
required for the CMS]1 verbs and exception handling» and the deta 
storage fer the varicus cata set records invoked by 4 pEregramr. 
Since the (MSII subsysters is embedded within the MCPII» and user 
programs perform UMS]1 o¢erations by means of the normal MCPII 
co#w#unicate wechanisa» the only extra code or data required ty a 
user prograea is generatec by the COnbOL compiler to build and 
issue the EMSII commtnicztes. The summary statistics printed ty 
the compider in each protram listing can be used to determine the 


total coce and data requirements for a procram. 
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KCPIT COCE REQUIREMENTS 


The wminiwus amount of menory required for the OMSII code within 
the PCPII is 6K bytess towever» the DMSII code working set can 
require as many as 40 bytes» depenaing upon what is actuatty 
being done and whether of not the data base uses audit and 


recovery. The code sorking set is composed of: 


1. The 6X byte miriaus mentioned in the preceding paragraphs 
which includes adi of the code that must be present to 
perfor any operation. This includes such itess as the 
code for the hencting of structure currents» buffer 


handting»s communiczte decoding» and exception handling. 


2 « An acditionat 4K bytes for routines which may te necessary 
to satisfy any request but which are not specific to the 
particutar requeste This incdudes such items zs [7/0 
initiation and/or clean-up» and structure anc file 


valication. 


5: The specific ccde recessary for the request heing 
processed. This figure can vary from 2 minimum of 1K Lytes 


to a maximum of SK bytes. 


he If the data base uses DMSEII audit ana recovery» the gudit 
routines» ait cf which fait tanto categories 1 and Zé» 


recuire an additiorat 4K bytes of memory. 


1152444 £-3 01/19/84 


VOCPII CATA REQUIREMENTS 


There are 14 types of data structures in memory which the OMSTI 
sutsyste# uses to procest a data basee Most of these data 
structures are starec by ail programs currently accessing 2 given 
cata base». These types cf data structures are: 

The gtobais 

The aucit FI 

The aucit tuffers 

Disk file headers 

Structure records 

Structure currents 

Lock descriptors 

Buffer descriptors 

Data tuffers 

1/0 cescrictors 

CMSTI work areas 

Ffecord work areas 

Status masks 

Fath dictionaries 
At cata base open tines» the UMSII system atlocates a singte area 
cf memory which is usec to contain the giobals and the I/0 
cescriptors. descrigtors. Path dictionaries are contained 
Within a user prograge*s tun structure nucdeus» are attocated at 
BOJs» and require no extrz memory tinks.e The other items are 
allocatec 25 needed» ang each occurrence of én item requires a 
gemory irk in acdition to the memory sizes in the fottowing» 
each mewsory tink is 187 tits in tength.- Each buffer descriptor 
is atlocated at the same time as the buffer it references and is 
contiguous to that buffers only one memory tink is required for 
a@tuffer and its descriptor. Similarly» the audit FIB anc audit 
tufferss which are presert onty when a data tase which uses aucit 


anc recovery is beirce upcated» are aliocated as a unit therety 


requiring cniy one memory tink. 
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Etobais 


NOTE 


In the discussion that foilows» 2 data 
structure is stared by ala users of the data 
tase unless specifically noted to the 
contrary. Alsc» when atlocating memory» if 
the PCPII finds an available space which is 
larger thar needed» it assigns the amount 
reeded and marts the remainder as avaitable. 
lf» bFowever the excess space 1s not targe 
encugh to Fold an availabie memory tink» the 
PCPII atlocatet the entire piece off memory. 
This can czuse any data structure to be as 
much as 187 bits targer than actually 


requirede 


The gtobals are containec in the first sequent of the data base 


cictionary» are trought 


cpened» 


arc must be t#ept 


programs accessing tke czta tase. fhe globats total 


epproximatetly 1K bits 


anc contain the following miniaus 


into memory when the data tase is first 


in mernory until there are no more 


infcrmaticr needed by the OMSTI system to process the data bese? 
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i. Pointers for file end structure informations beth in smemcry 


anc in the cictionery. 


“en Pointers to tock» tuffer» and [/0 descriptors. 


3% Boolean fields describing the status of such items as the 


data base or the atdit files 


he Fietocs for such items a5 totad users» transaction and 


syncrpoint counts» z¢gnd auacit sertatl numbers. 


5 The size of the dictionary fields used to access data base 
structures are 80 tits times the tarcest structure rumber 


aifocatece 


Audit File Inforeaticn Block 


The audit Fite Inforaaticn Block (FiB) is either 568 bits (for 
tape) or 804 bits Cfcr cisk) in length. It is buiit at the time 
cf the first operaticn wtich requires aucitirg from 2 File 
Parameter Glock whict is stored sxithin the data base dictionary. 
The FIB regvains in memory until there are no more programs 


upcating the data base. 
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Aucit Buffers 


The CMS1TI system ailocates two buffers for the audit trail» each 
of which has its own 1/0 descriptor. The tength of each buffer 
is equai to the BLOCKSIZE parameter froa the ALDIT TRAIL 
Stetement in the OMS/CASTL compiier Cdefauit = 1800 tLytes). 

These buffers are writter to the auait trait as they are fidlec 
or when a syncpoint cccurse If the DMSII system is in the 
process cf closing the carrent audit file anc opening 2 new one» 
éccitionat buffers cén be atiocated in order to atfiow user 
crograms tc contirue to execute whide this file-switching process 
takes piace» These extrze buffers are temporary and are 


ceaidocatec a5 scon és pessibte. 


Each 1/0 cescriptor is a system I/0 descriptors 272 bits in 
length. Gnty the originzgi two audit buffers have I/C descrigtors 
adiocatecs no 170 descriptors are aflocated for any over fiown 


eucgit butfers. 


The gudit FI8» 1/70 cescriptors» and buffers ere altocatec as a 


contiguous unit within memory. 
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Structure Records 


Structure records are stered within the dictionary and contain 
the information necessary for the DMSII system to use a 
carticuilar structure. Tey incitude static inforgation 
initialized by the B*S/DASOL compiters and dynamic information 
faintained by the DwMSII system within the gsesory copy of the 
structure record whide tte structure is in use. The static 
information inctudes suct items as records biock» and area sizes» 
key information for sets and subsets» and parent and object 
structure numbers» The cynasic information includes a count of 
users» mewmcry addresses cf items such as the DFH for the fite cof 


this structure» and parert and object data set structure recoarcs. 


Structure records are brecught into nemory onty when needed and 
refain ir memory wntitl there are no more users for that 


structure. 


Cisk Fite Headers 


The OMSIL system uses system disk file heacers CDFH) that have a 
length of 540 bits plus 76 bits per area declared. In accition» 
the ECMSII system appends to each DF the File Record for the 
fite> these file records are gaintained within the data base 
cCictionarys» are at tleast 132 tits in tength» and contain the 


foltcwing inforsatior: 
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File version stamp. <A 36-bit field which represents the 
last time the file was updateco by the UMSII system. This 
fielc is adtso gaintained within the DFH itsetf» and the two 
version stamps are compared when OMSIL first opens the 
file. The file open is adtowed onty if the two versions 


are identical. 


Setfrretative pointer. A Ll6-bit field used ty the OCMStii 
system tc update tte dictionary copy of the fite record 


when the fite is finatty closed. 


Size. A i6"bit field also used by the DMSII system when 


upcating the dicticnary copy of the file recora. 


Next Avattabie-Higtest Open (NAHO). One or more 64~Lit 
fielcs descriting the availabie space within the file. The 
actual number cf N#HO fieids within each file record is z 
function of the nunber and type of structures stored within 


the tite and czn be determinea from the fottowing: 


1)? Lists» priwe dzta sets» and non-prime indexese A 
singie NAHC is adso maintained for files containing «ny 
of these structure types. This NAHO is stored in cits 
133 througt 19€ of the fide record. The totai tengtt 


is 156 bits. 
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2) Nonvprime cata sete One NAHO for each area dectared 
for the data set. Totat shength is 132 bits pius 64 


times Carezs decitared). 


Each OFH is attlocatec when its corresponding structure is 
aliocatec anc remains in memcry until no programs are using any 
of its structures. The (MSII disk file headers cannot he 


cverlayec. 


Structure Currents 


The CMSid system uses the currents to uniquely identify a current 
record or path peinter fer a particular structure anc gitdocates 
one current for each user of a structure. In this contexts a 
user tnctuces éeny invocation of a structure within 2 program. If 
@ cata set is invokec more than once in a programs that ceta set 
anc ald cf its sets end subsets are each assigned a current for 
each invoke «xhen the structure is first upcatec® otherwise» onty 
current record pcinters that are referenced are invoked. Each 
user is cesignated by both job number and relative invoke numter 
within the programe. This aesignation is used by the D¥SII system 
to icentify each currente For example» if there are seven invoke 
statements within a civer prograss and the operating system 
CMCPILT) assigns job i25 to that program» the DMSII system 
eitocates seven currents for the programs and these currents 
woutc be identified «s jcb #425» invoke #1 through jot &25° invoke 
#7. Furthermores if the first two invokes in the prograns 


referencec the same cata set» there would be two currents for 
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thet data set aitocatedc for this programs anc these currents 
woulc be icentified ¢s jeh #425» invoke #1 and job &425% invoke 
Set and subset currerts tre a@ssicnea the same user numter as 


their parent data sete 


Currents are altocated ir a tinked tist from the structure 
records as referencec» ard are dealiocated when the pfrogranr 


referencing the current closes the aata base. 
The base size for a current is 632 bitse 


In acdititone the current for every structure that has an 

associated key is increatec by the tength cf the key for that 
structure. This adcitiora@l space is used ty the DMSIZI system 
kuilc the key whenever tte structure is accessed by that key. 
For cata sets» beth cisjcint and embedded» a hidden tutfer is 
altlocatec if it is required. For data sets» a set of status 
strings» three bits each» is aitlocated» one status string for 


each data set» its sets» and any embedded structures. 


42. 


to 
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Lock Descriptors 


Cne lock descriptor exists for every DMSIT record in memery that 
is locked at any given time. Each aescrigtor contains the meacry 
edcress of the buffer for the recorae the user to whom it is 
assigned» and the disk acdress of tne record. Additionatty» the 
lock descriptor identifies the reason for which this reccra has 


teen Lockece The resson can te one of the fottowing: 


User Lock 
A user pregram kas explicitly tocked this records by means 
of either a MOCIFY cperation of a STCRE after a CREATE 
operatione Gniy cata set records» both disjoint and 
embecdeds can be tocked in this fashion. This lock is at 
the recera lLevets that is» if severat cata set records are 
storec in a singte tlock» and one of these records has been 
locked ty a user» tten the other records are stitd ayzitatte 
to other userse Al*tor the locking process 18 non texctusive 
in that a recorc thet has been lockec by a user can stili be 
accessec ty other users through a FIND operations oniy 
concurrent MODIFY oferations ase prevented by this type of 


Lock. 


MCPIIT Read 
This is used by the OMSII system white 6 recorc is being 
reac to insure that the Memory Management routines within 
the operating systen (MCPII) do not avertay the recorc untit 
the CMSII systew hat compieted the current operation. This 


is a strictiy temporary conditions and the record is not 
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fockeda in and is untvatiabie to other DMSII users. 


wCPII tock 
This is aisc a tempcrary condition anc is used ty the DOKSITI 
system whenever a record has been attered by a partiatdy 
completed operatione This is an exctusive tock. Only the 
operating systesx (MCPII) can access the inforsation 
contained withir the buffer untit the operation has 
compteteds at which time the lock status of the recora 
returns to the state which existed prior to the operation. 
This function is necessary since the cccurrence of an 
exception during a rartiatlly compteteo operation requires 
that ali changes coapleted to that point be backed aut> 
this type of tock prevents any other user from eccessing 


information which tf in such an indeterminate state. 


Each tock cescrirtor is $0 bits in Length» and the DYSII systea@ 
aliocates them is a tingle table» five at a time» 2s required. 

If the number of lock cescriftors requirec increases» anenx tatle 
is obtainece ard the otd tock descriptors are copied to the new 


table. The olc tabte is then discarded. 
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Buffer Descriptors 


Euffer descriptors are uted by the LMSII system in the allocation 
anc #aintenance cf data tuffers in memory. Each buffer 
cescriptor is tlocatec imvediately prior to the buffer descritec 
anc within the same zgrea of memory attocated for the buffer. 


Cnty one memecry tink is required for each descriptor/buffer pair. 


Cata set and tist structires have buffer descriptors that are 144 
tits tong. Incex structares have buffer descriptors that are £0 
tits long. In addition to the fields containeo within a systeg 
cescriptors information such as the 24-bit togicat disk address 
cf the biock contained within the buffer» the number of users» an 
aucit seriagt number shict identifies the iast tigze the buffer sas 
upcated» two memcry eddress fietds which point to the next and 
prior OMSII buffers» and three bootean fietds used to control the 
upcating of the cisk copy of the information contained within the 


tuffer. 


Buffers 


Euffers are alitlocatec as needed and are deal tlocated as requirec 
ty the mewcry sanagenent system. The point «et which a buffer can 


te overtayed depends upor the foliowing criteria: 
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Has the buffer been updated? If not» then the buffer can te 
relezsed as soon as it it no tonger in usee If the buffer has 
been updated» then it must no tongers be in user ana it must te 


written to disk before it can be released. 


If the buffer has been urdated» does the data base use audit and 
recovery? If not» tke buffer can be written to disk and 
cealtocated as scon és mecessary» if the cata base does use 
gucit anc recovery» the (SII system uses a mechanism catied the 
unreiteased audit seriad ruber to determine uhen an updated 
tuffer car be writter. the qtobals for the cata base contain an 
aucit serial number shict is incremented by one each time any 
aucited operation occursse The current value of this number is 
then storec within the carrent audit buffer ena within the buffer 
cescriptcr fer the buffer just affected by the update. 
iherefores both the buffer descriptors and tte audit buffers 
contain fietcs which describe exactiy wher they were last 
upcateae When an aucit tuffer is written» its last zudit seriat 
rumber is stored within enother fieid in the globats. This 
fielc» the unreteasec aucit seriai nuaber», then represents the 
last audit which has beer physically written to the zcudit trait. 
khen atteapting to dealticcate buffers which have been updated» 
the CMSII system requires that the audit seriat number for that 
buffer céanrnct be greater then the unreleased aucit serial 
rumbers» thus insurine thet no part of the data base on disk 
represents changes which are more recent than any part of the 


eucit traii. 
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The size of any CMSI] buffer is equal to the vadue of BLOCKSIZE 
attribute Cin tits) cf tte structure referencec by that buffer 


gfius the tuffer cescriptcr. 


Hidden Buffers 


The implementation of renaps and togicat data tases require the 
accition of one tevel of buffering. This additional buffer» 
calied the hidcer butfers» is an intermediate storage tocation 
used in the process cf transforming the phystcai date sets into 
the remap data setS» and vice-versa. The following rules appty 


to the use of hicden buffers: 


le Hidden buffers are atlocated conditionaily. <A hidden 
buffer is cnty reatired if transformations are necessary to 
buitc a@ regap from the physical data set» or if any 


REACCNLY items exitt in the remap. 
Ze Hidden buffers are fixed in memory and cannot te overiaic. 


Je Hicden buffers canrot be shared by muitipie users- If a 
given resxap recuires a hidden buffer» then one hidden 


buffer is aiiccatec for each user of that remap. 


he If a hidcen buffer is requirea for a data set» then that 
buffer is attlocatec at each users first reference to that 
data set. Each hicden buffer remains ellocated until its 
user closes the cata basee Cio this extent» a hidoen 
buffer can be considered to be an extension to the current 


record pcinter for a cata sets itn fact» the two are 
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altocatec contiguousty in some instances.) 


Se A hidden buffer is onty used to store the cata items within 
the physical déeta set record. It does not inctude any tist 
heacs that migtt be required tor embedded data sets or 
manuéet subsets. The fength of the hidden buffer » 
therefcorer is the TATASIZE parameter for the ohysicail data 


set» as printec in the DMS/DASDL structure statistics. 


Gs Hidcen buffers are used onty tor data sets» both disjoint 
anc embecded. Hiceen buffers are never used for index 
sequential sets or subsets» for index random sets» or for 


manual subsets. 


Curing a find operation» the entire togicat record is moved from 
the systen buffer irto tte hidden buffer. The remap is then 
constructec by the OMS/0#S0L-generated cocee fhis code is 
cptitmizecs that is» fields which are centiguous in toth the 
physical recore and the remap are moved together. Items are 


movec indiviouasity orly shen necessary. 


When storing a remap recerd back into the data set» the 
transforeaticn operation: are reversed. READONLY items are 
cowpareds rather thar wowed» at this time. This code is atso 


cptimized. 
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When initializing data items during a create operation» the items 
within the hidcen buffer are initiadized» then they are 
trensforsec into the user record area as in @~ find operation. 


This ensures the vaticity of alt READONLY and HIDDEN data items. 


A hicden buffer atways exists for a data set which has variable 
format records» since the RECORD TYPE fietc is READOALY. This is 
the cntly case in which a hidden buffer can be altocated for a 


physical cata sete 


If either cf the OMS/DASTL SFILE or SSTRUCTURE options is set» 
then the CeS/DASCL tistirg includes the tollowing information 
about hicden buffers» by data set and remap: 

Structure nugsber and remap nusber. 

Lengthe in beth tits and bytes» of the user record area. 

Lengths in beth tits and bytese of the hidcen buffer. if 


these fieics are zeros no hidcen buffer is required for 
this iter. 


I/€ Ceseriptors 


The OMSLI system uses the program overtay descriptor for most 
buffer reac operations. Two extra ia/O descriptors are atlocated 
élong with the OFSil gtlotai fields. Qne is used for lookahead 


read operations and the cther is for tookaheed write operations. 
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CeSII Workarea 


If the DMSII system issues an 1/0 request in order to Satisfy a 
recuests» it can give up control of the precessor until the T/C 
eperation compietese In order to restart that operation when the 
I/C operation cosapletes» the OMSII system saves ait of the 
roreateard necessary to do the restart in the wortarez for the 
program which agade the request. The workarea for each program is 


#23 bits in length érd it attocated during data base open time. 


Fath Dicticnaries 


Fach entry in the path dictionary contains information about tke 
structures referencec withir the program suct as structure 
rumbers» version stamp» ard memory address of the structure 
record. A path dictionary is aitocated for each program using 
the CMSII system and is zilocated immediately after the OMSTI 


workarea. 


Each entry in the path cictionary its a normpat descriptors 64 Lits 
in tength. The number allocated for a program is equati to the 


rumter of structures referencea by the procram plus cone. 
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OPERATIONAL REQUIREMENTS 


Cf the 13 types cf déta ttructures» the memory space usec for the 
cata huffers is the single most volatite factor to be considered 
when catcudating the memcry needed to access a data tase. This 
is true because cnce a d@ta tase is opened» the gqtobeiss lock 
cescriptors» and [/0 descriptors remain in memory.» <Gnce 
atdccatec» the structure recordse disk file headers» and audit 
structures aiso remain tr memory» when servicing 2 specific 
recuests heowever» the CMSIT system allocates as many buffers as 
needed to satisfy thet request» and as soon as the operation 15 
compietes immeciatedy marks as avaidable any of the tuffers which 
were not updated by that operation. For any operations ait 
tuffers invoived in that operation are imcelicitiy lecked for the 
curation of the operéetior by the DMSII system. For find and lock 
cperéstionss the buffers for index tables or tist tables are not 
kect lockea fonger ttan required. N\ormatty» only one tuffer is 
kept isekec at a time. This is necessary for the following 


reasons: 


1. Since the CMSII system usuadty pertorms an operation in 
several steps» giving up control of the processor shite 
waiting for an I/0 operation to completes storing any 
infor#ation it neecs in the workarea of the user program» 
arc then restartine the operation once the I/0 operation is 
comptetes there car be severat partiaitiy complete CMSTI 
operations in g¢rocesss each from a cifferent progras. “In 


these circumstencet» it is absolutely imperative that no 


1152444 . E=-20 01/19/84 


program te attcwed to atter of even access information 
which may itsedf be in the process cof teing alterec or 
which may have beer useao in a partisaily establishec path 


for another prcgran. 


Ze In the case of updetes (stores delete» insert» or renove» 
if the OWMSIT systen encounters an exception white part way 
through the operation (for exampies a duplicate nas 
encounterec on an insert into an index for which dupticates 
are not aitiowec)d» it must back out ait of the changes mace 
to that pointe This can only be done 1f no other user hes 
been allowed to access any of the buffers which have been 


affected by the partiatily completec operation. 


The number of buffers recuired depends upon the type of cperation 
anc the particudar structure being processed. There is ne upper 
digit imposed upon ttre nember of butfers which aay be required to 


complete any operaticn. 


Cpene Ciose»r Free» Create» and Recreate Oper ations 


ho buffer space is required to compiete an opens closes freer 
create» or recreate cperetion. For open operations the memory 
recuired is equai to the memecry required for the glotals» I/0 
cescripctocrs» and lock cetcriptors.» The close operation requires 
no extra memory. The free» creater and recreate operations 438 
weld as ai1a cf the other operations mentionec in the following 
paragraphs» expiicitiy reference stauctures end can therefore 


cause the structure records aena/or disk fite headers to cke 
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trought into memory. 


Find/Lock (Modify) Operations 


Any find or flock operaticn requires at teast one buffer for the 
cata set recorc.e In addition to that buffer» the path which is 
teing usec to accomplish the operation may require extra buffers 
for tables. If at any time the OMSal system detects that a 
record neeced is alreacy in memory» the memory copy is 


éutomaticatiy used ard there is no additional memory required. 


The remairing paragraphs of this sutsection further describe tte 
aegory recuirec to perform a find of tock operations in terms cf 
the type of path usec to perform the operaticn. 


Cisjoint Data Set 


then performing a fird or tock operation which does not refererce 


@oset or subset» onty the data set buffer is required. 
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Incex Random Sets 


A fird operation by say cf an index random set requires» in 
edcition to the Gata set buffer» a cuffer for the index table, 
the tength of this buffer is the biocksize in bits for the set. 


In acditions overftos buffers can be required. 


Index Sequential Sets fnd Subsets 


The buffers requirec for an index sequentiat find operation can 
range from ore to five buffers for index tables plus the data set 


tuffer. 


Eubedded Data Sets 


If the operation is &¢ fird first» find tast» or find with a key» 
two tuffers are required. One DSUffer is needed for the parent 
cata set reccros which centains the list heacs and ore buffer is 


needed for the object record itself. 


If the operaticn is @ fird next or tind priors onty one buffer is 


required for the embedcec data set. 
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Manual Subsets 


In acst cases» a finc optration by way of a manual subset 
requires ore more buffer than a simitar find operation on an 
embecded data set. This additional buffer is for the cbhject déta 
sete The onty exceptior to this is a fast subset Cunordered 
Manual subset with a popetation of one)» in which case only two 
tuffers» ore for eact data set are requirec» since there is no 


tattle for the tist.e 


Insert Operation 


The number of buffers recuired to perform an insert operation can 


range from one to five depending on the following items. 


Parent Cata Set 


Cne buffer is usualty recuired for the parent cata set tn order 
to get the tist Feads for the subsete However» if the tist is 
tnorcered anc a current tist table tor the parent is adreagcy ir 
genory» the tist heacs are necessary onty if there is no space in 
thet table or any of the successive tables. If there is space in 
any cf these tables» ther the entry can be inserted without 
affecting the list heacs» and no butfer is required for the 
parent data set record. If there is no current table» or if a 
new tabte must be atlocated to compiete an insert on arn unordered 
fist» then the parent record must be made present in order to 


éccess the List heads. 
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Chject Cata Set 


For orderec subsets» the object data set must te made present in 
ercer to buiid the key irforsation tor the subset. This requires 
cne tuffer. WNo tuffer stace is required for the object record if 


the subset is tunarderede 


List Tabtes 


Zero to three buffers car be required for list tables depending 
upon where the new entry is stored. [Uf the new entry can Le 
faintainec by a fast subtet» the new entry is stored in the 
farent data set» and no Vist table 1s needed. If the new entry 
can te stored in an €xisting table» oniy that one tabie needs to 
be present in wenory. If the new entry causes the creaticn of a 
new tabte» the List tables on either side of tte new table must 
ke made presents in ercer to update the Llist heads within those 
tables» requiring a totat of three tables to be present. If tke 
nen table faiis at etther the head or the tait of the list» anty 
twe tuffers are required for tist tables since only the table 
which was creviously the heac» or previousty the tail» needs to 


be ugdated. 
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Unordered Manuait Subset With One Entry Per Tabte 


An unordered manual subset having one entry per tabte is treated 
@s a special case» fince there can onty te one entry per tables 
€ach new ertry must require a new tables therefore» there is no 
need for the OFSIT systew to search for available space within 
existing tables. Rather» if no current table for the subset is 
in memory» the OMSII system adds the new table to the enc of the 
list. This recuires two tabte buffers» ptus a buffer for the 
parent data set to update its list heads. If a current table 
coes exist» the CMSTI] system adds the new table immediatety after 
thet tabie» requirine three tuffers: one for the new tatie anc 
cne e€ach for the next ane prior tabies» ir order to update their 
dist heacs Cif the existing current is the Last table in the 


lists this casé€ 13 tcenticat to that of no current table). 


feaove Operation 


A remove operation nerwatiy requires onty one buffer for the 
current fist table. If» however» the entry bLeing removec is the 
fast active entry in a tzeble» then one of two more buffers are 
recuired in orcer to dealdocate the current table. If this tatie 
is the onty tabte in the chain for the parent data set records 
then only cne wore buffer must be present in order to update the 
fist heacs within the parent data set record. If there gre more 
tables in the tist» then two buffers are required in order to 
upcate the list heads within the prior ano next records Ceither 


one cf these can be the rfrarent data set rather than enother tist 
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table). 


Store Operation 


The gmount of semory reqtired to perform a store operaticn on 6 
cata set depencs prisaritly upon the type cf cata set» either 


cisjoint or embecdede 


Cisjoint Data Sets 


The emount of buffer space required for a store operation depends 


upon two things: 


ts The wanner in shict the current was establisted for the 
data set recorc» that iss is this a store operation after a 


create or a mocify operation? 


Ze If a store operaticn after a modify operations were any 
critical fielcs (those referenced ty a KEY or WHERE 


statements) chengec? 
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Store Cperation after a Create Uperation 


Under normal circumstances» this operation is the single most 
censanding cperation in terms of memory rearirements which the 
CMSII1 system can pertorm sinces in addition to storing the record 
in the dats set» the keys of the record wsust be inserted into 
every set» both index secuentiat ang index randoms which spans 
the cata set as welt as into every automatic subset for which the 


record quaiifies for membership. fhe buffer requirements ere zs 


follows: 
i. One buffer for the data set record. 
ae One or tko buffers for every index random set which spans 


the cata sete The second buffer is onty needed when a 


table is fildlec ane an overfion table must be aitocated. 


36 For every indey secuentiat set and every automatic subset 
for which the record quatifies for menmtership» a minimum of 
one gnc a maxigus cf thirteen buffers are required. This 
inctudes the fine table into which the key is placed» anc 
every coarse table necessary to get to that fine table. 

The test case requirement (two buffers) occurs when the 
fine tabde is pointed to directly by the root coarse table. 
The worst case reqtirement (six buffers) occurs when the 
fine tablte is fointed to by a fourthtevel coarse table» 
and the fine tzbte is fult ana must tbe split to conrplete 
the cperatione- In the tatter case» four buffers are neeced 


for the coarse tables» and two buffers are needed for the 
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fine tables. The rumber of tevets of coarse tables deperds 
upor the amount of tabde sptitting which has occurred» 


which is a functior of the fodtowing three itesrs: 
1) The number of entries per tabie. 


2) thhether the tozd is random or sequential retative to 
the key specification of the set. The tabte splitting 
a{gorithm used by the OMSil system produces the same 
resuit for eitter loading in sequence or reverse 


SEQUENCE. 
3) The value cf tte SPLITFACIOR attritute for the sete 


The effect that eact of these items has upon index 
sequertiail table splitting is aiscussed in detail in the 


last subsection of this appendix. 


Store Cperation Aftev a Modify Oper ation 


If no critical fields are changed» the only buffer requirec is 
that for the data set itsetf.- If criticad fields are changed» 
then» for any set of subtet whose key has changed the old key 
must be deletec from the set» and the new key must be inserted. 
The tuffers recuired for these operations are the same as those 
required for a normat delete from» and insert into» the specific 
set» either crdered cr retrievai. simultaneousty» if the status 
of the record» relative to one or more automatic subsets» 
changes» the subsets must be adjusted accordingly? the recorc is 


inserted into éeny nes sutset for which it now quatifies» and is 
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ceteted from any subset 4or which it no tonger quatifies. The 
tuffer requirements in ttis case are tdenticai to thase for key 


changese 
NOTE 


Althcugh 4a store oferation after a crezte operétion 
is normadty the most demanding operation in terms of 
menmcry requirec» tte extreme case cf a store 
operation after a rodify operation in which every key 
is changed» anc the status of every automatic sutset 
is changed» recuires more memory than a store 


operation after a create operation. 


Esbedded Data Set 


For 2 store cperatior after a create operation on an embedded 
cata sets the cCuffer reaqtiresents are simitdar to those for an 


insert intc a manual subtet except that: 


fs Since the data recerd is included in the table» there can 


be ro extra buffer required for an object record. 
f% There is nothirg cemparabie to a fast subset. 


laking the above itegs irto sccounts the number of buffers which 
car be required for tist tables for a store cperation after a 
create operaticn on en enbedded data set can range from one to 


three. 
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For a store cperatior after a modify operaticne onty the table 
buffer is necessary since key items cannot be changed on an 


crdered emtecded set. 


Cetete Operation 


For cisjoint data sets» then a record is deleted from a data set» 
the tuffer requiremerts ere approximately the sage as for the 
eriginal acdaitior of the record into the data set (store 


operation after a create operation). 


For embedded data sets» the buffer requirements are analegous to 


those for a resove operation fros a manuat subset. 


Begin transaction anc End€-transaction Operations 


If ano aucit cperation is requesteag on either of these 
coperétions»s no extra buiter space is necessary» When an audit 
operation 18 requested or these operations» a store operation is 
perfcrwedcs and the requirements are the same as those for 43 store 
operation on a simple citjoint data set.j therefores the tuffer 
reacuirewents for either 2 beginstransaction swith audit or 
encv“transaction with aucit operation are dependent upon the 
rumber of indexes dectared fer the restart data set» and whether 
the current restart record was established by a create or a2 tock 


cperation. 


1152444 B= 31 01/19/84 


CATA WORKING SET 


When estiwating the cata working set for an applications the 13 
types of data structures can be classified into the foilowing 


five groups: 


1. The cata structures brought into memory at data tase open 


tigwes the gtotats and two I/u descriptors. 


Ze The structure records» file records» and disk fite headers 


for every structure referencea by the z¢epplication. 


3 The gucit FIB end tuffers» if the déta base uses audit ard 


receverys», and the zpptication updates the data kase. 


4 The cata structures specific to the progrags(s) involved in 
the aoplicatior are the DMSII workareas currents» anc 


hicden buffers. 


5 Twice the number of buffers and buffer descriftors 
necessary to sz<tisty the typicat request made Ly the 
application. This prectudes the necessity of the OMSII 
System waiting the compietion of a write to the data base 
after an update operation before being able to reuse a 


buffer. 


A batch progras usuaity rfrerforms a singte function and therefore 
has a working set which is fairty sample te calculates however» 
the typicad onvwline proaram performs several types of functions» 
anc the working set for that program can change dramaticatly 


curing execution as the varicus remote stations perform such 
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cperations as inquiries» maintenance» or updates to trénsaction 


files. 


If the data base uses autit and recovery» the previousty 
@entionec Unreteased Audit Serial Number mechanism can cause a 
Significant increase in the working set fer programs which add or 
upcate fdarge numbers of records. This can cause the numter of 
tuffers within the werkirg set to be three or four times the 
rumber requirec tor the typical request» instead of twoe This is 
kecause the upcated tuffers cannot ce reatltocated until their 
respective audit recerds have been written to diske Four times 
4s méeny ctCuffers can te required if the updates in question affect 
wany index structures sirces» when updating index tables» the 
eucit information gereratec is fairiy s#aii (on the order of 1.5 
to 2.5 times the entry size for the structure) relative to the 
size of the aucit buffers and the table records themseivess 
therefores a series cf oferations could cause many table tuffer s» 
in acditicr to data tufferss to be hetd in memory even though the 


zucits for those operaticns have not fitted an audit buffer. 
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Exaaples of Working Set Catculations 


In each of the folioring four exampies» the data working set for 
@¢ specific OFSII apptication is catculated. Each exampie 
includes a descripticn of the application as weti as a detailec 
fist of any assuapticns shich must be made in order to perform 
the calculations. These assumptions include such items as the 
physical and ticgicat ccerfosition of the deta base and the 
sequence in which CMSETI cperations occur. Att of the 
calculations are described in terms of the five types of data 


structures outdined in tte previous subsecticn. 
NOTE 


Severai exptanztory notes appear at the end of each 
example. within the body of each examples» references 
are aade to these rotes by gezns of an asterisk and a 


sequence number enclosed within parentheses» such as 


(a1). 
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Exaupte 1: 


Applications 


The initial toad of a cata set which includes two index 
sequential sets» ore index random set» and four gutomatic 


subsets. 


Assuapntions: 


le The typical data record satisties the conditions for 


exactly one of the automatic subsets. 


Ze Ait of the keys: for the seven indexes are 10 digits (40 


bits) long. 


36 $ TAELESIZE 7 sas tpecified to the DMS/DASDL compiler» 
generating block sizes in bits of 10C5€ for each ordered 


path and 10080 for the retrieval set. 


he Stock size for the data set is two segwents (2880 bits). 
Ss Audit anc recovery ts not usede 
6» Ati cf the index sequential sets have 2 maximum of tuo 


levels of coarse teble (refer aiso to Note 3 in this 


exaaple). 


1152444 E=39 01/19/84 


10. 


Fec 


1. 


Each structure is ttored in a separate files 


has 4 waximua cf 2C areas. 


All key fietds and WHERE ttems are ccntiguous. 


and each fite 


Att af the indexes are to be toaded in pertecttly randor 


orcere 


Ald four autometic subsets use the same key field(s). 


uirements: 


Globais 923 
20 lock descriptors + link info 1824 
3 I/0 descriptor s 1584 
1 memory link 167 

Tctalt 4518 


bits 
hits 
bits 
bits 


bits 


structure records(1) 


1 data set 7f@E bits 
1 retrieval set $68 kits 
€é orcered sets 7032 tits 
é@ memory tinks 1496 bits 
Icotais 10264 cits 

Structure recorces pilus DFH4%s 22980 


Audit and recovery is not used. 


Path dictionary (43) 720 
Status gask (1 inwoke? 109 
Workarea 661 
Currents (*4) 0 


Ictat 1481 
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bits 


bits 
bits 
bits 
bits 


(565 bytes) 


DFH*s(€ az) 
1456 bits 
1292 tits 
8352 bits 
1496 bits 


i269€ bits 


(2873 tytes) 


bits (185 bytes) 


01/19/84 


Euf fers: 
2 data blocks 
2 retrieval tables 
9-15 ordered tzbtes (*5) 
13-19 buffer descrirtors 
13-19 memory Links 


Tctat 


Totat fer att 5 groups 


1152444 E-37 


5760 
20160 


90504-150840 


1872- 
2431- 


2736 
3553 


{207277183049 


(15091- 


22ks8i 


149706-212028 


(18713- 


26504 


bits 
bits 
bits 
bits 
bits 


bits 
bytes) 


bits 
bytes) 


01/19/84 


NOTES 


Structure records ere compesea of? 


Data set? 644 bits dbase) 
32 bits dkey tabte) 
112 bits icurrent) 


788 bits 
Retrieval set; 844 bits (base) 
32 bits dkey table) 
92 bits icurrent) 
968 bits 
Crdered set: 844 bits Cbase) 
32 bits «key table) 
256 bits (base current) 
40 bits ikey at end of current) 


1172 bits « 6 Structures = 7032 bits 
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Disk file headers ere composed of? 


Base CFH: 540 bits «DFH) 
720 bits «20 area eddresses 2 36 bits each) 
68 bits (version stamp and cortrotl info) 


1328 bits 
fata sets 1328 bits <base CFH) 


64& bits cdcunused) 
64 bits «CNAHD) 


1456 bits 


Retrieval set: 1328 bits Cbase DFH) 
64 bits «NAHD) 


1392 bits 


Crdered sets: 1328 bits dbase CFH) 
64 bits (NAHO) 


1392 bits x 6 Files = 8352 bits 


The number of entries in the path dictionary is one 
more than the ruster of structures referenced in the 
prograg» and egch entry is 80 bits in tength. For 
this appiicaticns ¢€ight structures are referenced? 
therefore» the pat? dictionary contains nine entries» 


anc is 720 bits in length. 


Onty the base currents which is appended to the 
structure records is necessary since there is only 


one user for etch *ttructure. 


The typical case fer any two successive records» 
given a truly ranocm toad of an ordered set» is that 
the keys for ttose records have no index tables in 


coercn cther than the rcot coarse tabie. Therefore» 
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the working set for such an index inctudes onty ane 
copy of the roct ccarse tables two buffers for any 
flower tevel cozrse tabtes» and two tuffers for fine 
tabies. In this example» best case is three buffers 
per incex Croat coz~rse plus two fine)» and worst case 
is five buffers (best case plus two extra buffers for 
second"tevel ccarse tables). Since the typical 
record is spanned ty both ordered sets and one 
automatic subset» the minimum number of buffers 
required for ordered paths is nine (=383)» and the 
maxigum i5 15 (=32*). The nugwber of memory tinks 


varies accorcirngtys 


Exanpie 23 


Application 
The initiat loac of the same data base describec in exaapte 


l» with audit ard recovery added. 


Assumptions 


1. Att of the itens assumed true for exampte 1» except for 


item 5» are alto assumed true for this exazgple. 
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4» 


Fequir 


Le 


2 


1152444 


Aucit is tc tare» and the audit buffer 


dength. 


The restart data set has a 


is 1600 bytes in 


biock size of one seqrent 


The restart set has a key size of &9 bits (10 bytes). 


ements 


Same as exampie I» 


structure records CFH's 
Festart data set 786 bits 1456 bits 
Festart set 1172 bits 1352 bits 
2 wnemory finks 374 bits 374 bits 
Total from erpample i» group 2 ig284 bits 2656 bits 
Totals 12618 bits 5918 bits 
Structtre records and DFH*s 28536 tits (3567 bytes) 
Audit FIé 566 cits 
2 audit buffers 2880C bits 
2 I/€ cescrigtore 544 bits 
Mesrory Link 187 tits 
Total 30099 kits (3762 bytes) 
Path dictionzry (+*1) 880 Lits 
Status mask (2 irvokes) 200 bits 
Workarea 661 cits 
Currents 0 tits 
lotal 1741 tits (218 bytes) 
Buffers: 
3 data btocks 6640 kits 
hestart data set 1440 bits 
3 retrieval taties 30240 bits 
12-21 ordered tables (*2) 1206727211176 tits 
19-28 butter descriptors 273€- 4032 bits 
19-28 memory tinks 3553- £236 bits 


group 1 


45186 bits 
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Total (*3) 167281~-260764 tits 
(€20910- 32596 bytes) 


Totat for ati 5 groups 232175-325654 bits 
C29022- 40707 bytes) 


NOTES 
The path dicticnary requires il entries. 


Because of audit ard recoverys there must be a 
sufficient numter cf buffers tor three fine taktes 
anc three secord@tevel coarse tables per index 
sequential set or tubset» instead of the two buffers 
each required when audit and recovery is not used. 
Oniy one copy cf tte reot coarse table is needed. 
Therefore» the best case becomes four LtLuffers per 
incex» and the worstt case becomes seven buffers. 
This makes the minimum number of buffers 12 (=2%4), 


anc the maximun nusber 21 (=3«"7). 


Aithough the werst case requires 28 tuffers to te in 
memory at cne times no single operation can ever 
require sore than 12 buffers to be tocked at one tise 
{one each for the cata set» restart cata set» and 
incex random sets» znd three for each of three index 
sequential sets)Js therefore» at no time shoulc this 
application recutre that an overflow teble of tock 


descrictcrs be aticcated. 
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Exampte 33 


Application 


A single progras doing incuiries into the data tase 


described in exnemples 1 and 2. 


Assumptions 


1. Either of the two ordered sets can be used for the 


inquiry. 


2-e Cniy FIND cperétions are performed» and therefore the 


tuffers are atwvays immediately avaiiabie. Space for 


two copies of ¢ach buffer is not needed. 


Requirements 


a 
Same as exanptles 1 and 2 4518 bits 
Ze 
structure records DFH*s 
i data set 788 cits 1456 
2 ordered sets 2344 bits 2784 
3 memory tirks 561 bits 561 
Total 36923 bits 4601 
Structure records and DOFH’?s 6494 bits €1062 
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cit 
bil 
bit 
bit 


by 


Audit ard recovery 15s not used. 


he 
Same as exanpte 1 (#1) 1481 bits 
5. 
Buffers: 
1 data btorck 2880 bits 
2-3 incex tables (*2) 2€112-3016€8 bits 
3-4 butfer descriptors 432- 576 bits 
374 mesgory tinks 5S61- 748 bits 
Total 23985-34772 bits 


C29S8- 4257 bytes) 


Total for att 5 groups S@478~-4E08€5 bits 
(4810- €108 bytes) 


NOTES 


When a disjoint cata set is tnvokeds the COBOL 
compiler buitds an entry in the path dictionary for 
every structure cescrited within the 
DSm/CASCL-generatec tibrary file for the data set 
regarddess of shict structures are actualty 
referenced in the rest of the program. In this case» 
the path dicticnary includes entries for eight 
structures» even though onty three structures are 


actualty used in tte programe. 


At feast the rcot coarse table and a fine table must 
be presents a Seccndtevel coarse table may be 


neeced. 
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Exanpie 43 


Applicatian 
A program that tpdates the data base describea in examples 
1» 2» and 39 anc which is running concurrently with the 


inquiry program described in exampie 3. 
Assumptions 


1. The update procram uses the retrieval set to access the 


cata sete 


2@e The key fieta for the automatic sutsets is changed tut 


not the WHERE condition. Therefores each tige a record 


is stored» the otfd key value must be deleted from 


whichever subset references the records» and the new key 


value must be reinserted into the sage subset. 
fFequirements 
1s 


Same as in €xamptes 1 throught 3 4518 bits 


Same as exanpie 2 above (#1) 28536 bits 
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Same as exanpte 2 above 30099 bits 
4a 
For the inqtiry progran 1461 bits 
For the updéete program (*2) 1741 bits 
1 extra current for the data set (*3) 112 tits 
1 memory iirk 187 bits 
Total 3521 bits (440 byte 
5s 
Buffers 
For the irquiry program (44) 23985- 14372 bits 
For tke urdate program: 
3 cata buffers £640 bits 
1 incexy random butfer icog8o bits 
l restert data set 1440 bits 
7-13 crdeved tables (#5) 70392°120728 bits 
12-18 tuffer descriptors W72@- 2592 bits 
12-18 saemory tinks 2244- 3366 bits 
Total 218509°191218 bits 


C14814- 23502 bytes) 


Tctat for ali 5 groups T6510 3-257E92 bits 
(€23148- 22237 bytes) 


NOTES 


Every structure is referenced by ane or both of the 
programs. Actratiy» the update program atone woutd 
require ail of the structure secords sincer whenever 
the CMSII system detects a key change (from the data 
set's key tabte)» tt must bring in att of that deta 
set"s structures tr order to reevaluate each key 
separately» anc determine which sets have been 


affected By the key change. 
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The update procram's requirements for path 
dictionaries» statts masks» and workareas are 
identical to those of the program described in 


example 2. 


Oniy one extra current is required since the data set 
is the onty structere expticitiy referenced by both 
programs. With this exceptions neither program has 


any direct effect cn the other for these items. 


The inquiry proegraa's buffer cequirerents are the 


same as in exaspie 3. 


The CMSI1I system hendies a key change cn an index by 
performing a detete aperation on the old key and an 
insert on the new keys Since the buffer requirements 
for a delete are the same as those for an inserts the 
working set for @¢ tey change should te analogous tec 
that fcr inserts itrto two sets with the excertion 
that since only one set is involved» there is need 
for orty one rceot coarse table. Referring to note i 
for exampie 2» the best case is 7 buffers Croot 
coarse table pius ? fine tables for the deletes and 3 
fine tables for the inserts)» and the worst case is 
13 btuffers (best céese plus 3 secondetievel coarse 


tabies for bott the detete anc the insert). 
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TABLE SPLITTING 


With the exception of tuitferss the gata structures usea by the 
CMSITI system are marked ¢~5 SAVE memory? that is» the data 
structures such as globats and disk file headers cannot be 
overiayec ty the MCPIJI ard must remain in memory until either the 
cata base is closed cr tte structure has no active users. D*SII 
tuffers» hcwever» are refeased as soon as possible. In spite of 
this» buffers are typically the greatest singte cemand upen 
gerwory withir the DMSII stysteme In addition» the majority of 
butfer spcae is norgsatly occupied by index tables ~- data that is 
rormésliy transparent to the users. in exaaspies 1 and 2» buffers 
accountec for approximatety 752% to o0% of the total CMSII data 
requirvewents» anc incex tables accounted for approximately 902% to 
$5% cf the tctel buffer tpacee Note that these two exampies were 
part of the extreme case of an initial toace For an application 
which is not acding cr deleting great nusbers of records» not 
cnty do total weacry reqeirements diminish» tut the ratic of 
incex table buffers to tctal buffers also ci#inishes» as exanple 
2 shows Capproximatefly 65% of total space is used by buffers» éend 


about 852 of the buffers were index tabies). 


As mentioned previousty» buffer space for index random sets is 
usuaily oniy as small as a single table» tut a second buffer cén 
ke required if the UrSII system needs ta aitocate an over flon 
tatle. However» index sequential sets and subsets cain reauire as 
wary as five tables.» The asount of memory required to perfor@ an 


cperation upon an incex sequential set depends heavity on the 
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rumber of tables which aust be brought into memory tc coaplete 
the cperations and this in turn is gependent upon tre amount oft 


tabte spoditting whict hat been done on that set. 


Aithough the splittirg algorithms which the OMSII system uses 
affects the amount cf splitting that occurs» the user has tittle 
cortvol over these algorithms. Other factors which affect the 


émcunt of spiittings and over which the user has controls are: 


1. The maxifue nueber of entries per tabie. 
Ze The order of the tread. 
te The SPLITFACTCE& setting for the structure. 


Incex Tabie Formats 


Eoth index ranco@m anc tineex sequentaat use the same table formet. 
This aitlows both tabte srtitting algorithms to share significant 
farts of the code» Exaeries of this are insertion of an entry» 


celetion of an entry» anc cthers.e ihe tabte format its: 


01 Index Table Bitistructure.buffer.size)» 
O2 Fiagqs Biti2)>» 290 ~ reserved tor tater use 
O02 Audit serial nimber Bit€d32)» 2 Last update if auciting 
02 Index type Bit«(2)» 2 0 = lowest Level 
21 = next tevel 
2 2 = any higher level 
O02 Entry count Bitdi2)» % Count of valid entries 
02 Next table Biti24)» 2 Each devei cf table is 
% linked together 
O02 Prior tabte Bita24)o 2 IS ~ doutie linked 


2 I-R ~ base tabte adcress 
02 Index entries (structure.rcds tik) 
Bit (structure.record.size)» 
2 each entry 15 structureerecordesize bits tong. 
% there are structure.ercdsebik (tablesize) entries. 
% the fcermat of each entry is: 
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03 Address bitC 32)» 


04 Area bitdBh)» 
04 Disptacesent Bitt16)» 
04 Record BitC Ad» 
03 Key bitt(stricturesekey.~size)» 
O02 Structure runber BitdB)» 2 Used for address check 
02 Area Bitch)» 4 Oun area = for address 
02 Disotacemert Bitii6)» % Oen disptacement 
02 Checksum B8itd«24)» 29 - reserved tor tater 


Tabte Spditting Algorithaes 


Each time a record is adced to an ordered set» the OMSII systeg 
enters the key and acdrets for that record into a table.» Entries 
within each table are saitintained in sequence by the keye Entries 
are eddec to a tabte until that tabae is fuli- At that pcint» a 
new table is created» the existing entries are sptit between the 
clc and the new tabte» ard an entry is made in the next highest 
fevel table that poirts to the new tabie.w This can recuire a 
split at the higher ftevel» and so one The atgorithm works the 


Same way at every Level. The detaids of the algorithms follow. 


Incex Random 


Incex rancom uses a Fashing aigorithm to cause the base table to 
te searched. Note that cnty the first 30 characters of the key 


ere usede 


Incex random base tattes are initiaaized so that they have a 
singte entry containing @n address and key of edt bits set. Ech 
new entry is placed in tte table in ascencing key sequence. When 
an atteapt is mace tc intert an entry inte a full tabktie» the 


tabde is split prior to waking the insertion. 
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check 


use 


When a split occurs» the first sptlitfactor entries are teft in 
the current table» 2¢ new table is atlocatec and iinked irte the 
cverflow list immeciztely fottlowing the current entrys and the 


remaining entries are mowed to the new table in its sortec place. 


The next tabde pcinter it used as a onevway tinks linking the 
tase table tc tts overficw table» and in turn tinking each of the 
overfiow tables to the next overflow table. The next table 
pointer whose bits are alti set signifies the end tink. Entries 
for any table on the overfion List are always sorted and are of 
greater than or equai value to the entries for the preceding 
table anc are cf tess thin or equal vatue to the entries for the 
foltowing table. The initial entry with ait bits set is always 
the last valid entry in the last table of the base table and its 
everfiow liste. The initial entry is inctuceo in the count of the 


rumber of entries in any table. 


Since the tabtes are alwzys saintained in @ sorted orders a 
tinary search can be usec on index candom as well as index 
sequentiai. If duplicates are altowed» then the duplicates are 
always storec in the reverse order in whict they were entered 
into the data base Ccuplicates first). Reerganizatian preserves 
the sequerce of duplicates on any set whict coes not have a 
rocutus change or any key item chanye or goes from duplicates 


atlowed to duplicates not altowed. 
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The process of executing a find operation at a specific key 
consists of performirg a hash operation to find the tase table» 
reading the desired tabie» and then doing 4a tinary search cn the 
table. If the search is successful» then it returns the first 
entry in the tabte with the aesired key valuew If the search is 
unsuccessful and the tast key in the table is tess than tte 
cesired key» then the overfion link is usea to access the next 
table and the process preceecs with the reading of the overflon 
tatie» This process continues untia the desired key is found or 


a key greater than tke desired key is founc. 


The prior table pointer ziways contains its own logical address 
if it is 2 base tabte. If it is an overfitow table» it contains 
the logicat adceress cf its base tabie. The atgorithes used for 
secuential processing (required for the generatized selection 
expressions) begins nith the first wase table. It searches each 
base tabies then each of the overftow tables from that base 
teatie.e It proceeds to the next base tabte and its over flown 
tattes. This process cortintes until the tast base table and its 


cverflows have been searched. 


An index rancor delete removes the appropriate entry» anc if that 
entry was in an cverttlow table» it then attempts to consolidate 
tables. If the number of entries in this table has been reduced 
to zero» then the tattle is deltinked and returned to aveitabte 
spece» {ff the number cf entries in this table plus the preceding 
table is fess than SFLITFACTOR entries» or if the number of 


entries in this tabte is one and the prior table is not fuits 
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then the entries in this tabte are moved to the prior tabkie anc 


this table is cetinked ard returned to avaiitabte space. 


Incex Sequential 


The CMS/CASOL initialization of index sequentiat tables consists 
of allocating a root table pcinter in the file record ena setting 
it te nudi Cali bits seti. The UMSal system reccgnizes this 
condition on the first store and attocates a root tattle» sets the 
roct table pcinter» enc sakes one entry in the root tabte with 
aid bits set (a nulf key and a nudi address). The numter of 
levets of tables can vary from zero to five. Zero levets are 
inctcative of gn empty irdex. One devel is @ valid grrangement 
enc consists of a sirgte fine table referenced by the root table 
rointer. The fifth tevel is arranged with one tevel of fine 


takies referenced by four devels of coarse tables. 


Ali tabtes are aaintaine« in sorted order and ascending sequences 
Cescendirg sequence is performed by complementing the key bLefore 
sorting. Each entry in <¢ fine table contains the key cof the déta 
record and the data record address. There is one entry in the 
fine tables for every record in the data set that shoudd te 
referenced by the incex. There is one entry in a coéerse table 
for each table at the nest tower level references Cy this coarse 
table.» The key tn that entry 15 the highest valued key in the 


next tower table and the address is the address of that table. 
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The process cf gettirg ttrough ail devels of the tables to finc 
en entry consists of obtzining the root table pointers reacing in 
that tabte» coing a tinavy search on that table» anc if the tattle 
is net the fine tabte» centinuing the process ty taking the 
sacress from the entry fcund and repeating the cycle by reading 
that table.» While searcting coarse tabtes» the binary search 
need not return an exact match but returns the first entry with 
eo key value greater thar or equai to the desired key» when the 
fine table tevet is finatly reached» an exact match must be found 
for 3a find operation or z NOTFOUND exception condition is 
returned. For a deiete cperatione an INTEGRITYERRCR exception 
condition ts returnec if the exact match is not found. Necte that 
in the delete cperation» the address is aiso checked for an exact 
matches and in the case of a store operation» an exact match is 


not needed» but is acceptabte if duplicate records are altoawecd. 


After finding where the tey shoutd te lLocatec» the store 
cperation proceecs by checking for available space in this tabie. 
If there is space avzitatier then the entry is piacec in the 
current table in its sorted position. If there is no space 


eveitabtes» then the table must be split. 
The gigorithm used te split a tabte folions: 


1. The first decision to be made is where to split the tabte. 
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[Tf the new entry it placed higher than SPLITFACTOR entries» 


the split is at SPLITFACTOR entries. 


If the new entry ts placed lower than (tablesize ~ 
SPLITFACTOR) ertries» then the sptit is done at (tabtesize 
~ SPLITFACTOR) entries.j Otherwise» the split is done at 


the place where the new entry goes. 


The entries in the table that are toner than the sptit 
tocation are mceved to a new tabte anc the remaining entries 
are wmovec to the trp of the table. the new entry is ptaced 
in the appropriate table Cif it fatls on the split» it is 
placed ir the first entry of the old tabte). The tast 
entry in the new tzebie is then propagated as a store on the 


next higher tevel table» which can aiso need to te split. 


If the split occurs on the highest tevel of a table» then a 
nen root table must be allocated and the root tabte pointer 
must be updatec appropriately. The new root table has tuo 
entries in it» one of which references the key of the tast 
entry in the new teble and the address of the new tabie. 

The cther has a key with ali bits set to ON and on address 
of the old tabte (Cehich was the previous root table). The 
maxigue rumsber of table tevels of tabtes is five. If this 


Limit is exceeceds a LIMITERRLR exception occurs. 
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The store cperation coes not have any special handling of 
cupticates if cuplicetes are altowea.e. Any additional entry is 
pdaced in front of ary ctrrent entries with duplicate keys 
Cdupticates first). Larce numbers of dupticéete records cause no 
overhead on the store operation. Tne onty overhead associated 
with large numters of curtlicates are those involyeo durinoe delete 
operationss the dupficate key with the correct address must te 
founc»e For the average cetete operations this requires searching 


tatf of the dupticate key entries. 


Each tevel of tabte is tinked together using the next table 
pointer arc the prior tatle pointer.j The OMSTI system sets ait 
tits to CN in the next tzble pcinter to incicate the end of the 
dinks» Whenever a tzbie is split» the new tabte is dtinked 


appropriately and the ott table links are adjusted. 


These pointers in the fire tables are used during FIND NEXT» FIND 
NEXT AT <key>» and or gereratizec selection requests to alton 
secuentiai access to att the entries without traversing the tree 
structure. Thus» onty ore tevelt of table pointers is kept in the 


current information cf irdex sequential as wetl as index randon. 


An index sequential cetlete starts by finding the proper entry end 
searching cuplicatess if necessary» untit the proper key and 
adcress are tounc» That entry is removed and an attempt is mace 
to consotlicate tables. If the number of entries teft in this 
table is net tess then (tabtesize ~ SPLITFACTOR)» or if it is the 


last table on this levels then no consolidation can occur. 
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If consolicaticn can occtrs then the next tabte is checked. If 
the rumber of entries in that tabte plus the number of entries in 
the current table is less: than the tablesize» then the current 
table is combined with tfe next tabier therety elisainating the 
current table. fhe entry in the next higher tevet tzble for the 
current table must be celetede. If combining takes places then 
sdjustwents are made to the next appropriate table and prior 
table pointers and the cirrent table is returned to avaitabie 


SPpacCE€o 


if consolication can occtrs but combining cannot» the entries in 
the current table anc the next table are civided equéeliy between 
the two tables.» Uf the totat number of entries is an coda numters 
then the extra entry goet into the current table. Because extra 
entries have been accea to the end of the current takie» the key 


in the next hicher tlevet table must be adjusted. 


If a deletion occurs which reduces the root tahie to a singte 
entry» then the root table is deadiocated and the root table 
cointer is updéted te point at the next tower tevel table. If 
the root table was a fine table» then the index structure is 
empty. This is the same as after the DMS/DASDL compiter hzs 


initializec the root tabYe. 


There is cne other speci2t conditione If the highest entry in a 
coarse tabite is deteteas then the key for that tabte in the next 
higher table is adjusted. Each entry in the coarse tables aiwzys 
have the key of the bFicghest entry in the next lower table. f[Thet 


key zdjustaent may Feve to propagate up to the next tevel. 
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These algorithms have the property that each table» except the 
hast on each tevel» aisnays contain at least (tablesize ~ 


SPLITFACICR) entries. 


Basec on the information presented in the previous péragraphs » 
the cefautt setting for SPLITFACTOR (75%) should generality be 
used» If the initial tozd is in orager» SPLITFACTOR can te 
incréasede The degree te which SPLATFACIGR epproaches 1002 
ceperds upon the way in shich addttionadl records are to be added 
after the toad and what rercentage of the ultimate population of 
the set the initial load represents. If almost adi cf the set is 
to be toaced» cr if etl Further additions are in order» either 


forward or reverse» then SPLITFACTOnK may be as high as 90%. 


Entries Per Table 


The cptisgus number otf entries per tabler in teras of efficiently 
@acping 2a sets is the sctare root of the expected fopulaticn of 
that set. This is true tecause the maxiaum number of cata set 


records thet any coarse tabte can span is: 


(entries per coarse tabte) X Centries per fine table) 
If the nuwker cf entries per table is the square root of the 
expected population cf tte set» then it is theoretically possittle 
for the root coarse table to span the entire set with no tower 
level coarse tables.» However» even with such a table size» sowe 
spiitting almost adways cccurs due to factors such as the order 


cf the toac. 
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Although the scuare root of the expected population is the 
cptimum setting for entries per table» memory considerations 
cfter force a reduction in this setting for sets of any 
zppreciable size. This is true since incex tables cen become 
very targe when using the square root of the population for 
entries per tabte» espectaity if the key for the set is more ttan 
just a few bytes tonce For examptes a set with a popuiation of 
402000 and a key size of 16 btytes would have index tabtes 32,000 
kits (4000 bytes) in teneth if the square root of the population 
was used for entries per tabte. For a siailar set and a key size 
of only five bytes» the tabie size nould onty be 142400 bits 


(1600 bytes). 


Coarse tabie splittirg is a certainty if the maximum number of 
entries per table is lese than the square roct of the populaticn. 
Entries per tabte shcultd never be set below the cube root of tte 
poputation. If they ares it can cause frequent splittings dcur 
to the fourth tevel cf ccarse tables where any further attempts 


to split would resuitt in a LIMITERRUR exception condition. 
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APPENDIX F 


OMTIL DATA STRUCTURES 


This section contains the record descripticns for ati the CMSTI 
cata structures referenced in this document. This section is 


civiced into three sebsections: 


le Data structures used by the DMSII system in the processing 


of a data base. 


Ze Data structures used primarily by the OMS/DASOL compiter. 


5% Aucit file and audit record formats. 


CMSII Data Structures 


The cata structures cescribed in this section are used by the 
CmMSL1 system in the processing of a data tase- these structures 
car te maintaineac in any of the fites in the data base» irclucaing 
toth the cata base dicticnary and the files which are usec to 


Store the varicus structtres in the data hase. 
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CMSI£ Gichatls 


The CMSITI €tobats are originaldy initialized by the DMS/DASDL 
compilers and are aivays maintained as segsent zerc cf the dats 
base dictionary. The CMSII Gtobats are first brought into memory 
when the cata base is opened» and remain in memory until the lest 
user closes the data base» The OMSal Glotals contain pointers to 
aid of the other data structures» both in memory and in the data 


tase dictionary» which are needed to process the datz tase.« 


All of the foitowing fields that are prececed by a singte 
asterisk (*#)» are initialized by the DMS/DASDL compiter. Att 
fietcs precedec by tso atterisks (**) are initialized ty the 
CMS/DASDL compiler» tut can be changed throuch use of the 3M 
input messages Alt cther fietds in the OmSII Gtobats ere 


initializec by the TrvSII system when each cata base 1S opened. 
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CECLARE 2 
01 DM_GLCBALS @€F7(1440%>, 2 
202 Cw_CASUTUL_ WERE ICN BITCE)>» 
% Must watch the current MUPII to process the data tase~ 
% 3500 = 23 Sel = 33 62.0 = 4% Gel = 53 720 = 63 
2 8.0 = 8% (7 if used for an intermediate stage by the 
% Reorgnization used to convert a data base to the 6.0 
% format o 
02 Ce_LUSEFS BIT4(6)> % current active users 
02 CM_USERS_UPCATE FLI(6)>» 
% numter of active users who have actuaily upcatec the 
% data basew 
O2 Cwe_DOQL_DICT_@#OCR BIT(36)» & disk address of db dictionzery 
202 OGM_GLOBALS_ICTAL_SIZE BITC1icds 
% Lencth in bits of Gtlobats» inctuding the structure cictionary 
O2 CM_GLOEALS _ACDRESS BITC24)> % adaress in mencry cf the Globais 
02 CY_GLOEAL_LOCK_BITS BITC2)> 
O2 CDM_IGO_CESC_HEAD FIIC24)> % memory address of first I/C desc 
202 CV_MAX_STIR BITCBS» ZX highest valid structure nuater 
#02 CM_GLOEAL_FLAGS FEIT(6) 
#03 DM_OMSHL ELTCI)» & this is a DMSII data bese 
03 FILLER BIIC5S}» 
O2 FILLER B817C30)> 
02 OM_DATA_BASE_LIN¥ BITC24 )» 
Z usec to tink the Globats of adi active cata bases 
O02 ECM_STATUS_FL&#GS ELITE)» 
03 DM_CPEN_UFDATE BITC1)» % an update has cccurrec 
O03 DM_WRIVJE_ERROF GITC1)» Z db must be shut down 
O03 OM_RECOVEFRY_I*_PROCESS B4T(1)> 2 Dump Recovery required 
03 DM_RECRGANIZATION BITC1)» % no users can eccess the db 
03 FILLER B11C4)5 % 4 more ftlags 
02 CM_LO_FEAD BITC24)» 2 memory address of tock descriptor tatte 
O2 CM_NEXT_LD B1TC1€)> 
% offset of the next avaitabile entry in the tock 
2 descriptor tatie 
O2 CM_LDE_TABLE_LENGTH BITC16 dp 
2 size in bits cf the altocated tock descrictor table 
402 EM_CDICT_PACK_ICD (THARACTERCLU)> 
202 CM_DATA_BASE_NAME CHARACTER(LO )» 
#02 CDCM_STR_OFFSEY BIIC16)>» 
% starting tecord numbers in db cicttonary» of first 
% structure reccera 
#02 OM_DFH_GFFSE! GI1C16)> 
Z% starting record numbers» in db cictionary» of DFH tattle 
*#aQ02 CM_WAIT_LENGTH BITC1LE )» 
% tenths of secends to wait for contention resolution 
«02 OM_NMBR_IO_DESC EILT(4)> 
% ignored = Mart 10.0 always has one descriptor for tookahead 
2% reacs and one for tookahead writes 
O2 DM_AUDIT_STATUS ELTCZ0)>» 
e003 OM_AUDIT E1TCe d» 
£004 CM_AUDITED_08 BITCL)» 2% => restart data set exists 
#a04 CM_AUCIT_FIAG BITC1)» & current setting of AUDIT option 
O3 OM_AULTITFALE_CK BITCL ds 
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% audit records can be placec into audit trait 
O03 OM_SYNC_LECK ELTCiL)» 
z reset => (MS saiting for syncpoint to compiete 
O03 DM_SYNC_IC_COINT BITC2)> Z # of Sy¥yncpoint I/0*s in progress 
03 DOM_FRCGRA®S OF BITC(1)» % 0 => Progréem Abort has occurred 
O3 OM_AUCTIT_FIB_#@LLOCATED BaTC 1)» & audit fite has been opened 
03 DM_INGUIRY_ GK BITC1)» 
2 0 => Procram Abort necovery scheduled or runnirg 
O03 FILLER BIIC3)» 
O02 CM_AUDIT_EXCEPTICN_STATUS B&iTC4 D> 
2 indicates the status of the audit buffers when CMS 
2 is Switching zudit files 
O02 Ce_ALDITFILE_STATUS BITC4 )» 


20 3 closec 
1 3 open 

% 2 3 na disk 

% 3 3 file full 
% 4 2 closirg 

% 5 3 openirg 

2% 6 3: I/0 error 
* fF 2 not ready 


O2 DM_AUDIT_SERTAL_*MBR BITC 32)» 
% Next ASN to be assigned. DMS/DASDL generates a random vatue 
% for this fiete when the aata bese is first createds from that 
2 pcint on» OMSTI incremencs this field by one each time anothe 
2% record is written to the audit trail. 

O2 CM_UNRELEASEL_AUCIT_SERTIAL_NMBR B11C22)> 
% Highest ASIN which has been physicatty written to the audit 
% trait. No updeted buffer with a higher ASK can te written 

02 Owe_AUCIT_DESCRIPIOR BITC 80), 
2 system descrirtor pointing to audit FI8 in memory 

O02 CM_AUDIT_FAIRST_GYERFLOW BITC24)> 
2 CMSII attiocates overflow audit tuffers if a temporary 
% concition prevents the normal emptying of the 
% audit butters. This fieto points the first CFLC buffer. 

O2 CM_AULCIT_LAST_OVERFLOW BIiT{c4)» 2 memory address» tast OFLO 

#02 CM _SEG_DICT_CESC BIT(64),», 
% Nerwad descrirtor which points to the code segment 
2 dictionary in the data base dictionary. This code is 
% fcund in the CPI at data base open. 

«02 CM_SEG_CICT_CFFS*T BITC16 )» 
% recerc nusber in the data base cictionary for the working 
% copy cf the OFS code seguent dictionary 

O02 CM_CCCE_PAGE BIT(6)>» 
“2 which of WCPIT segments « through 7 was tlast used 
% for this cata base 

*02 OM_VERSTIGON_CCDE_ SEG BIT(5 )» 
2 segawent ir CMS/DASDL code containing the version 
% checking code ; 

#02 DM_VERSION CCCE_CISP BITC16)>» 
2 disclacewent within previous code segment 

02 OM_IN_FROC_TRANS BIT(6)» &% total users in transaction state. 

O02 CmM_TRAAS_COUAT BITCI2)» 2 transactions since last syncrcoint 
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O02 DM_SYNC_COUNT BIW12)5 % syncpoints since tast certretrpoint 
eaQ2 CM _SYNCPCENTS BIWI2)» & transactions per syncpoint 
aa0Z Ce_CONTROLPCINIS BIT€12)5 % syncpoints per controtpoint 
02 FILLER BIYC3)> 
«*02 DM KEYCCMPARE BIIC(1)>» 
% => compare keys when accessing by way of en automatic set 
% or subset 
402 CM_STR_NAME_CFFSFET BITC16)>» 
% recerc nusaber in ch dictionary of a table containince the 
% names of gti cf the structures. 
202 OM_DB_AAME_GFFSET BIIC1O)» 
ZZ record nusber in ab dictionary of a table containing the 
% names of eld flogicai data base names. 
2% Entry 0 is the physicat aata base name. 


Logicad Addresses 


The OMSTI system mairtairs no absolute disk addresses in the 
processing of a cata base. Instead» ali addresses ere maintained 
in relation to the disk tile area in which a given recora is 
located. These retative»y or LOGICAL» addresses can te either Zz4» 


32,5 or 36 Lits in lergthe 


Incex tables» including index sequentiat coarse and fine tables» 
és weld as att index rancom tables» are normality referenced ty a 
24-bit address- Specific entries within an index tabie are 


referencec by 36-hit aacdressese 


Cata set records ana tist tables are referenced by d2-bit 
edcressese However» there are two distinct formats for these 
32-bit addresses» depending upon the ptace in which the address 
is stored. The normet 3¢@-bit address is used whenever the 
adcress is maintainec within the data base dictionary or an incex 
tables» or is used in any of the cata structures used by the CMSII 


system which onty exist in memory. 
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The following is the togical address format. 


CECLARE 2 

01 ADDRESS_24 B1IT(24)» z 

O2 AREA_24 BITE)» % disk fide area numbers zero relative 

02 GISP_24 BITC16)»> % starting segrent numter within AREA 24 
O1 ADDRESS_36 BITC36)» 4 Usea for atl addresses in currents 

02 AREA_36 BIT(8)>» % same as AREA_24 

O2 CISP_36 BITC16)» X same as DISP_24 

O2 ENTRY_36 BITC12)>» ZX entry numter within this tabde for 

% indexes or «ecord number for other structures 

O1 ADDRESS_32 BLTCI2)> % Mark 8.0 tormat 

Q2 AREA_32 BITE)» % same as AREA_24 

02 CISP_32 61716)» % same as DISP_24 

O02 RECORD 32 BIIC@d» % retative record number within this btock 
O01 OLD_AQDRESS 32 EITC?2)>» 2% pre-Mark 8.0 format 

O02 FILLER BITC1)> z 

O02 CLLE_AREA_32 EITC? )>» % samé as AREA_24 

O2 CLO_RECORO 32 BIW)» 2% same as RECORD_32 

O2 FILLER BITC13> z 

O2 CLOE_DISP_32 ETT(16)% 2% same as DISP_24 


CFH Tabte 


Each entry of the CFF Tatte contains static informations 
initiatizec by the CwS/DESDL compiler and used by the CMSTI 
system» concerring the files in the data tasee Each entry is 480 
tits in tength» with three entries per disk sector. One file is 
@ssigned for each structtree The totat nusber of entries in the 
CFKH Table is COM _MAX_STR + 1). If an entry is inactive Ca 
structure has teen deleted from the data kase descriptions and 
that structure number has not been reused)» the DFH_FILE_ NP BR 
fietc in the correspcencirg OFH Table entry is set to 0 (zero). 


Entry zero of the DFt Tatte is not usede 
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CECLARE 2% 
O1 DFH_TABLE_ENTRY BIT(480)5 % 
O02 DFK_FILE_NMBF BI11K8)» 2% 
O2 CFELFECGRCE_PIR BITC16)> Z% offset into dictionary for FILE rec 
O2 OFH_RECORD_ SIZE EILTCIE)» & hength in bits of FILE rec 
O02 CFE TITLE CHARACTER CSO)» % external file name 
03 DFH_PACK_IC CHARACTERCIO)» Z 
03 DFH_MULTI_FILF_ID CHARACIERC 10)» 2 
03 OFHFILE_1C CtARACTERC10)» 2% 
O02 FILLER BITC8)»> & 
O02 CFELAREAS BIIC8ds 2 maximum number of areas 
O2 CFR_LAREALENGTH BIT(C16)» 2% sectors per area 
O02 CFR_SECURITYIYPE BIT({2)» 3% 
O2 CFRLSECURTTYLSE ELT(2)> % 
02 FILLER BITC4&4&)» 7 
O02 CFHLINIT_EOF_PTR BITC24)» 
O2 DFR_LNAME CHAFACTERC1I0)> % not used 


Fite Records 


The File Recorcs are initialized by the DMS/DASDL compiter» anc 
gSaintained by the OMESII systeme The DFH_RECCRD_PIR fietd within 
each DFH tabie entry poirts toe the tile Record for that file. 
The CFHLRECORD_SIZE fietc describes the bit tength of the File 
Fecord. Each Fite Recore starts on a sector boundarys any 


unused space at the end cf @ sector is unused. 


The CMSI1 system wairtairs the Next Available - Highest Cren 
CNAHC) informaticn fer ezch data base file within the Fite Record 
for that file. Each NAHC consists of a pair of J2-bit Logical 
edcresses.- The first 32*bit address is the Next Avaiteable (NA) 
fietc» anc it cescrites the next record to be atlocated. The 
second 32-bit address is the Highest Open CHO) field» anc it 


contzins the acdress just beyond the highest allocated record. 
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If a file contains a datz set» then one NAHD exists for each area 
cectéared fcr the file. For ati other files» one NAHG exists for 


the entire fite. 


CECLARE 2% 
O1 FILE RECORD BITI(OFH_RECORD_SIZE)»> 2% 
02 FILE_ACDRESS BIT(16)» 2 setivrretlative pointer sithin dictionary 
O02 FILE_SIZE BIVC163» % = DFH_RKECORD_SIZE 
02 FILE_VERSTON BIT{36)» 2% version staap for this file 
O02 FILE_NCN_PRI®PE_DS_NAHO> 2% 
% This is used only if the file is used to store 3a non-prisre 
% cata set. For titles which store indexes» tists» cr prime 
4 cata setss the field FILE_SIMPLE_NAHC its used. 
O3 FILE_OS_N#HOCEFH_AREAS)» Z% one for every érea in the file 
04 FILE_DS_NA BIT({32)>» 2% 32-bit address 
04 FILE_DS_HO BITC32)» 2 32-bit address 
O02 FILE_SIMPLE_NAHQO REMAPS FILeé_NON_PRIME_DS_NAHO> 2 
% used fcr afi other fites 
O03 FILE_WNA BITC32)> 2% 32-bit address 
O03 FILE_HO @17€32)3 z 32-bit address 
O3 FILE_fACOT_PITR BIT(24)5 2 
24~bit address of the root table if this file is used 
to store ar index sequential structure. If this field 
is equéet te aFFFFFFa» the root tabie has not beer 
aitocatec» and the index is empty. 
Not used fer fites which store any other type of 
structure. 


ww Www NE ON 


Structure Records 


The structure records are one sector in tengthe and each 
structure record is at ar offset of (DM_SIR_GFFSET + STR_NMBR) 
from the start of the data base dictionary. The tast structure 
record is at an offset of C(DM_STR_LOFFSET + De_MAX_STR). If there 
are any gaps in the structure nugbers»s due tc structures being 
celeted from the date bate description» then the structure record 
at the appropriate offset for the missing structure rurmber is fet 


to ZEroese 
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All the fietds ir the structure record are static and maintained 
ty the OMS/DASCL compilers except for those marked by an asterisk 
(*) charecter» which the DMSII system maintains while the 


structure is active. 
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CCL 2 


O1 STRLCTURE_RECORC BITC1440)> & 


02 
02 


02 


D2 
02 


02 


202 
02 
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STRF_NMER BIT(83)» % = 0 => Inactive structure record 


STR_TYFE BITt4)> 

Z 1 3 disjoint cata set 

% 2 32 index rancom set 

% 3 2 index sequential set 
% 4 3 tist 


STR _USER_COUNT BITC6)» % total active users 
STR_LBUFFER_LCCK F€IT(2 )» 

2 If non-zero» ro buffers tor this structure can be overtayed. 
STR_BUFFER_LIST_FOINTER BITd24)» 2% memory edcr of first buffer 
STR_RCOS BLK BIT(12 )» 

% data sets = records per block 

”% indexes ertries per tabte 

2% tists t<ebles per biock 
STR_SEGS_ ALK BIT{8)» 

STR _RECORE_SIZE EILTC16)» 

x data sets * tegical record size 

% indexes ertry size Ckey + address) 

% tists tebte size 
STR_BUFFER_SIZE FITC16)» 
STR_BLKS_AREA BITC16)» 
STR_SEGS_ARE# B1ITC16)» 
STR_OFt_PIR ELT(C24)>» % memory adaress of this structure's CFH 
STR_CFRK_CFFSET_YC_EXTENSION BITC16)>» 

2 Offset into DFH for DMSIa fite record 
STF_CURRENT_FIR ELT(24)5 % memory address cf first current 
STR_STF_FLAES BIWWCS D>» 

03 STR_PRIME BIT(1)» 

O3 STR_DUPLICATES BITC1I)> 

O3 STR _SIMPLE_KE BITCL)» 
2 The key for this structure is: 
2 1.2 Unsigned Cindex sequential or ordered tist onty) 
z 2. Ascending Cindex sequential or ordered tist) 
2 3. A single item» or items which are ccontigucus 
4 the data set record. 

O03 FILLER BIIC5),» 

STR_SYTR_PARTICUL?IRS 

O3 STIR _SPLITFACTCR BITC1IZ)» ZX indexes ontlys 

O03 STR_TABLE_ENTFIES REMAPS STR_SPLITFACTOR 

O3 STR_MCCULLS BYT(16)» % index random onty 

O3 STRLENTRY_SIZF REMAPS STw_MODULUS BITC 16)2% lists 

O03 STR_HIDGEN_EUFFER(64) BIIC1)» 2 Data sets» emb or disje only 

STR_EMBECDED_INFC_SIZE BITCibd» 2% 64 times # of embecced str's 

STF_STATUS_STRINE_INDEX BITS)» 

4 Offset into status string of outermost data set for status 
% string for this structure. 

STR_STATUS_STRINC_SCOPE BIT(8)>» 

% Total tength cf status strings for this structure ana ait 

Z% structures esmtedded in this structure. 

STR_E€LCBALS_FTR FITC24)>» % memory address of DE Globalis. 
STR_OMS_FLAGS BITCB)» 
O03 STR_ORDER_FLA€ BITC1)» 


e¢ 64 6 


% Physicat bdock size tn bits 


in 


in # af entries 
BITC 12)» % lists 
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02 
02 


02 
02 
02 
O02 


02 
02 


02 
02 


03 STR_RESTART_DA@TA_SET BITA1)> 

O03 STR_MANUAL_SUESET BITC)» 

O03 STR_NEW_FCRMATY BIT(1 )» 
Z This strecture uses new 32"bit address format» and has 
Z new Eloct controt information in each tabte 

03 STR_EWBECTEC EFLTC1)» 

O3 FILLER BI1C3)>» 

STR_CATA_SIZE BITC16)> 

% Length of recerds excluding tist heads 
STRLHEAD_OFFSET FILTC1I6 )» 

% Offset into pzrent data set reccra for list heeds 
FILLER BIT(24)» 

STAR_PARENT 8@37TC8)> 2% parent structure number 
STR_GBJECT BITCS ts 2 object structure number 
STR_NEXT_SITR BITS)» 

% Used to tink zit indexes associated with a disjoint data set 
STF_CURRENT_SIZE BITC16)» Z tenagqtt in bits for current string 
STR_COCE,_INDEXCS }» 

2 up te 8 code addresses pointing into the CweS/CASCL~ 
% generatec code te perform various functions 
2 on this ¢tructure. 
O3 STF_COCE_SEG BIT(6)» 
O3 STF_CODE DISF BITC1I6 )» 
STR_KEY_SIZE BIT(12)>» 
STR_LIST_MEYV_OFFSET BITC16)» 
2% Offset irto ordered tist tabte for the key 


% The remainder of the Structure Record exists onty within the data 


xX base 
2 irto 
02 
02 
02 
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cictionarye The (€MSITI system does not read the foliowing fields 
Femory when wsine a structure: 

FILLER BIT(236)>» 

STR_NO_KEYS EITCE)» 2 numbers of key items for this structure 
STR _KEY_INFOQC26 3» 

O03 STR KEY_CFFSET BITC(163» & starting tocation in data set rec 
O03 STR_KEY_ SIZE ELTCL2)» % wey field length 

O03 STR_KEY_SIGNEL BIT(1L)» £4 1 => key has sign dectared 

03 STR_KEY_DIRECTION BITC1)s ZX 1 => cescencing 
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Stendard (Disjoint) Data Set Records 


Each disjoint cata set record is composed of user data and 
control information. The user data contains alt the data items 
cefired in the DMS/CASCL sourcee Lt the recerd tas variable 
formats» then att the ftived format tields precede the fields 
contgined in the variable format part. The tength of the user 
cata is equai to the STR _DATA_SIZE tietd in the Structure Record 
of the data sete. The cortrot information is onty present if 
there are any tists embecded within the data set.» Ezéch embedded 


fist requires 64 bits of control intormation. 


The fielc STR RECORD SIZE in the Structure Record is norgmatty 
equal to the sum of fTR_TATA_SIZE and €64 x number of embedded 
lists). Hcwever» if this sua is less than 80 bits» the OFS/TASCL 
compiler increases the size to 80 bits. tThis is done because the 
CMSI2Y system requires 60 bits at the begirning of each record to 
eagintain the Next Avzilatie (NA) tinks and a dead flzq. The dead 
fieg is : special bit patterns 48 bits in lengths which 
identifies a record that ties betow Highest Open for the file>» 
tut has been deleted anc is available to te reatlocated. The 


format of the cead flag is: 


afFFFFQ CAT 2HHHe CAT QFFFEQ 
Where aHHERe = @E01a 4 2 * structure number. When processing 
sequentiaily through a atta set» the DMSII system ignores any 


records containing the dead flag- 
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The format for a date set record is as follows: 


CECLARE % 
O01 STAKCARD_ CATA_SET_RFCORD BIICSIR RECCRD SIZE)» % 
O02 DATA_SET_GCATA BITISTR_DATA_SiZE)>» 2 
02 LIST_READS BIICSTF_EMBEDDED_aNnFG_SIZE) 2 
03 LIST_HEADCSTR_EMBEDDED_IN¢tO_SIZE/64) Z% One for eagch tist 
O4 LIST_FIFST ELTC32)» 2 
% OQid 3embit address of the first table in the list 
04 LIST_LAST BITC32)>» % Ox«d 32-bit address of tast tébtle 
O1 DEAD _ RECORD REMAPS STANCARO_DATA_SET_RECORD BETC BO)» 2 
O02 NA_LINK BITC32Z2)> 3 
% Cdd 32-bit z~doaresss when this record is reused» this field 
% becomes the new NA for the data set. 
O2 DEACT_FL4AG BIT(48);5 2 


List Tabies 


Each dist table is @ togicat records cont2ining control 
informatior (the Next Litt and Prior List fields and a ccunt of 
active entries)» enough trpace for SIR_TABLE_ENTRIES» and ¢ 327tit 
a@ucit seriat number. The aucit serial number represents the 
current ASA when this tattle was tast updated Cor zere if the dzta 


base does not use Aucit end Recovery). 


If a table is cetetec» the space occupied ty that table is placed 
into the NA chain for the list. Ondy a Next Available link is 
gresente. Since lists are never accessed in the physical sequerce 
of the file containirg tte list» there is no need for a dead 


flag. The forsat for list tables iss 


CECLARE 2 
O01 LIST TABLE BITCETR_FECORD_SIZE Dd» 2% 

O02 LIST_CCNEIROL_LINFC BITC/72)5 «& 

O3 NEXT_TABLE BIWC32)» 2% 
% Olid S$2-tit eddresss aiso NA tink for deletec tables 

O3 PRICR_TABLE BYTC32)» FZ Gad Ser~hit address 
O3 LIST_ACTIVE_E® TRIES BITCb)» & 

N2 LISTLEATRIESCSTR, TABLE_ENTRIES) BIICSTR_LENTRY_SIZE)» 2 
O3 EMBEDCED_CATA_SET_ENTRY>» % 
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04 EMBEDDED _DS_ DATA BITCSTR_DATA_SIZE)»> 2% 
04 EMBEDCED_ KEY BITCSTR_KEY_ SIZE #® NOT STR_SIMPLE_KEY)» Z 
% Cnty present for comptex keys 
O4 EMBEDDED_LIST_HEADS BATCSTR_EMBEDDED_ENFO_SIZE) 2 
2 Cnly pretent if Lists are emtedded in this dete set 
OS EMBECCEL_LIST_HEADC(STR_EMBEDDED_INFO_SIZEs64) 2 
O6 EMBETDED_LIST_FaRST BIIC32)» % Old 32-bit eddress 
06 EMBECLDED_LIST_LAST BITC32)» 2&2 Cid 32-bit acdress 
O3 MANLAL SUESET_ENTRY REMAPS EMBEODDED_DATA_SET_LENTRY> 2% 
04 SUBSET_KEY BITCSTR_KEY_ SIZE)» 2% Only if STR_CRCEP_FLAG 


04 SUESET_ADOFESS BITC32)» Z Gid 32-address of abject recorc 


Q2 LIST_ASN BIT(32)3 % Audit serial numter of last update 


Incex Tables 


Cne format is used fer all index tables» whether they be index 


sequential coarse or fine table» or index random table. Each 


CMST1 index tabte is divided into three parts: 


1. 


For 


the 


flag 


Header irformatione This includes tke Next and Frior Tatte 
fietcse a table identification field» an audit seriat 


nugsters and a count of active entries. 


The actuait index ertries. 


Traiter inforaztior. This includes the structure rumber 
anc a self-relative fogical aadress. These fields are at 
the end cf eact bicck for checking purposes» to ensure that 
the entire bicck wes read of written during each T/C 


oper 2ztione 


inactive tabdes» the NA tink field is the tirst 72 bits of 
first inoex entry- fs in the case of list tables» no dead 


is required for index tabtes. 
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CECLARE 


z 


01 INCEX_TABLE 


02 


02 


02 
02 
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INCEX_KEAD BI1TCQ9E D> & 

O03 INCDEX_FLACS BITC{Z2)» ZX Not used 

O3 INDEX_ASN BIT¢32)5 % Audit seriat number of tast upcate 

03 INDEX_TEL_TYPE BIT(2)> 2% 

0 2 points et data set records (index random tables» or 
index sequential fine tabies) 

index sequential coarse table» pointing at a fine table 

index sequential coarse table» pointing et ancther 
ccarse table 

3 2 not usec 

U3 INDEX_ACTIVE EILTC1i2)» ZX Lurrent active entries in table 

03 INDEX _NEXT_TAFLE BITC24)5 % 

% For incex sequential tables» points to next table on the 


1 
2 


NM mR NM NH xe 


x same tewels if = @FFFFFFe» ro more tables at this tevet 
% For index random tables» points to next overflow table for 
z the current hash vatues if = GFFFFFF es» neo more 

2 overftos tables 


O3 INDEX_PRICR_T®BLE BITC(24)> 2% 
% For index sequential tables» points to prior tabte on the 


z same teyetls if = QFFFFFF a, this is first table at 
2 this level 

% For index rzndom tables» points to base table for this 
z hash vaue> base tabie points to self 


INCEX_CATA BITCSTIR_RCDS_BLK x STR_RECORD_ SIZE)» 2 
O3 INDEX_ENTFYCSTR_RCDS BLK J» 2 
O4 INTEX_CBJ_FODRESS BITC32)>» 2 32-bit address of otject 
% recora 
04 INCEX_FEY ELAICSTR_KEY_SIZE)» Z 
INCEX_ANA_LIWNK REWAPS INDEX_UATA BIIC2Z4)» & 
INCEX_TAIL BITCSE)»> & 
03 INDEX_STR_NO ELTC8)> 2 The index*s structure rumber 
O03 [INDEX_SELF_ADIRESS BIT(24)5 2% This table*s eddress 
03 INDEX_CHECK_Stm BIT(24)> % Not used 
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CMS/DASCL Bata Structures 


After the CMSTI Globats» the Structure and Fite Records» and the 
CFH Tables the remairder of the data structures nithin the dzté 
base dicticnary are used to store the information reaquirec by 
CMS/TASCL to perforw an UPCATE compite of the data base Atl of 
the tables discussec in this section are inittattly azintained in 
memory by the CMS/DASDL compiter during the compitation of the 
cata basee They are written to the dictionary at the end of the 


coapite. 


CMS/DASOL Gtobais 


The CMS/CASDL gtcbal infcrmation is storec in segment 3 of the 
cata base cictionary» Tris cata structure is the OMS/DASCL 
ccppiler*s analog to the DMSII Gtobats- This is the first data 
structure loaded by the {MS/DASDL compiler when performing an 
LPCATE compiie. The OMSsSDASBL Globals contain fietds which 
cescribe the tocatior ant size of the rest of the cata structures 


to be reloaded from the cictionary. 


For each tabte of the CMS/DASDL compiler» there is 2 pair of 
fielcs tabeled xx_CSeh_PTF_ and xx _TbL_CNT. These fields contain 
the starting seqeent numter within the dictionary» and the numter 
cf entries» respectively» for each tabte of the DMS/TASDOL 


compiter. 
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CECLARE 2% 
01 DASEL_GLOEALS EL1TCIUS40)» & 


O02 CASCL_CATE_TIME EILTC36)» % when the DMS/DASDL compiler 
% was compited 
O02 CREATE_DAVE_1VIME BIT(36)» Z% When data base was first compitied 
O02 CRIGINAL_DASCL_VFERSION BITC od» 2% See DASOL“VWERSICON in CM“GLOEALS 
O02 CICT_ECF_PTR BiIT16)» 2 Last record of daté tase dicticnary 
O02 HICHEST_STR EITCE D>» % Highest structure number 
O02 COL_CSK_PITR EIVCI6)» 2% DOL Tabie info 
O02 COL_TBL_CNT ELTTCIHI» & 
O02 NAPE DSK_PTF BIT(16)5 X% Name Tabte info 
QO2 NAME_TEL_CNT BIT¢16)» 2% 
O2 PTK_LCSK_PYR ELTC16)5 2% Path Table address 
O02 DATABASE PTR BIT(16)> 2 DOL pointer of tast togicét cata base 
QO2 KEY_CSK_PTR EITC16)» % Key Tabte into 
O2 KEY_TBL_CNT ELYTCI6)» 2 
02 POL_OUSK_ PIR EILTC16)» 2% Potish Tabte info 
02 PCL_LITBL_CNT ELTCI6)>» 
02 ATT_DSK_PTR EITC16)5» 2 Attribute Table info 
02 ATT_TSL_CNT ELTCI65)» 2% 
02 OFR_OSK_PTR ELITC16)» 2% OFH Table info 
92 CFR TBL_CNT ELTCI6)» 2 
O2 STR_CSK_PTR ELTCI6)5» &% First Structure Record address 
02 INWV_TBL_CNT ELTC16)> 2% Invoke Table Address 
O2 LIT_CSK_PTR EIT(€16)» % Literal Table into 
O02 LIV_TBL_CNT ELTCI6)» 2% 
O02 SNT_DSK_PTR ELT€16)5» % Address of the Structure Name Table 
O02 CBA_TBL_PTR ELIC(16)» % Data Base Name Tabte Info 
02 CEA_TBL_CNT ELTC16), 
O2 INV_TBL_CNT EITC 16)5 &% Numuer of entries in Invoke Tattle 
02 FILLER BITCBI> &% 


HASH _TABLEC61) BITCIE)» 2 


2% A hash value is generatea for eack 
this tattle points to the first entry 


% bases 


2% for each cf tte pessibte hash values» 


identifier in the data 
in the DEL table 
0 to 60. Att cf the 


% DCL entries hzving the same hash yvatue are linked tcgether. 


The fottowing exceptions from the xx_DSK_PI1R and xx_TBL_CNT pairs 


ere noted: 


1. 


There are no 


SNT_TOBL_CNT. 


the Fath and 


fields labeled SIR_TBL_CNT» PTH_TEL_CNT>» or 


The limits for the Structure Records» 2nd for 


Structure Name Tabies» 


are exactly equai to 


the KIGHEST STR field» making specific fields for these 


lirits redundart. 
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és The INV_CSK_PTF ane INW_TBL_CNT fietcs are noncontiguous 
within the OMS/O0ASTL Gtobals onty for reasons of space 


availabitity. 


DDL Tabte 


The DOL table entries are 380 bits ian length» with three entries 
(1140 bits) per cisk sector. The remaining 300 bits per segmert 
ere not used. Entry zere is not usede- Many of the fields within 
each DOL ertry are ce~spzetials that is» 2@ field hés more then 
one meaning» dependirg ufon the nature of the item described by 
the entry. These co~spatial fietds are identified by either 
recetinitions of a fieid» or by describing subfields. For 
exampter COL_VERIFY_FTR is used for data sets onty. The 
sutfietds COL_CCCURS and DDL_FRACTIuUN are used onty for cata 
items. these fields share the same area of the ODL entry» but 
the weaning shcuid be clear» since LDL_WERIFY PTR ane 
COL_FRACVICN cannot toth occur in the description cf any ane 
ite@. Untess any astiguities occurs no extra mention is wade in 


the cescription of trese cotspatial fietds. 
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CECLARE 2 
01 DOL_TABLE_ENTRY BIT¢380)> % 
O02 CCL_NAME_PTR BI¥(16)» % Offset into the NAME table for this item 
Q2 COL_NAME_LENCTH EIT(H8)» 2% Length in tytes cf the ttem"s nawe 
92 COL_STF_AMER BIT(8)>» % Structure it occurs in 
O02 COLLAMF_NMBER BIT(8)s % The remap it occurs in 
02 CCL_VRE_NMBR BIT(B)»> & The variable format it cccurs ir 
O2 CCL_TYFE BIT(4)>» 2% What type of item does this entry describe 
aqata base 
cata set 
set 
subset 
access péth 
cata iten 
invoke of a structure. An entry exists in the CCL Tabte 
for every invoke of a data set. Since the cefiniticn 
cf a physical data set is aiso an impticit invoke 
cf ttat cata set within the physical cata 
tase» the OMS/DASDL compiler constructs 
two {DL entries for each physical data sets 
cne entry for the data set definitions and 
cne entry for the iaplicit invoke cf the deta set. 
file name 
TYPE EITC&#)>» 2&2 Further descrites the item : DOL_TYPE 
restart cata set 
index secuentiat set 
inders secuentiai Cautomatic) subset 
group item 
internal file name - not used 
ordered tata set 
ordered sanuat subset 
alphs data item 
auttivfilerid 
unorcerec data set 
unorcerect manual subset 
indes rardom set 
numeric cata item 
file-id 
cisjcint data set 
pack~ia 
forwerse reference 7 
Wherever the DmS/DASOL encounters a 
reference to an item which has not yet been 
declared (for example» é& manuat subset 
declaration might refer to a data set which 
has not yet been descriteds simitarty» the 
key déeciaration for such a subset references 
datz items which have not been declared)» a 
DCL entry must be buitit for stech en iteme Atl 
forvard references must be resolved tefore the 
data base can Ge inititalizec? wher this 
resctution occurs» the DOL entry is updated. 
Therefore» there can te no OOL entries with 
@ stbtype fiela of “forsxard reference” in a 
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02 


02 
02 


02 
92 


O02 
02 
D2 
02 


Q2 


02 


02 


02 


02 
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2 datz base dictionary on disk. 
COL_HASH_LINK BI%1C16)>» % Next DOL item with same hash vatue 
Z dabeled *HL™ By DMS/DASULANALY 
CLL_VERSION ELTC26) % version staap of this item 
COL_COMMENT_FTR FITC24)»> X 
2 If there was a quoted comment for this items this points 
2 into the LITERAL tabte. Same format as PCL_OPEFANT_PTR in 
% the POLISH tebte. 
COL_LEVEL BIITC&)» % COBOL tevel number» = 0 for cata bases 
COL_PARENY BITCIE)» 2 Previous item at DDL_LEVEL~-1 
2 dabeted *PT" by DMS/CASLLANALY 
CCL_PREV_SAME BIW(16)» % Previous item at sawe OCL_LEVEL 
% tlabeled "PS" by OMS/TASULAN ALY 
COL_NEXT_SAME BITC1i6)>» X Next time at same DOL_LEVEL 
% tlabeteda "NS* by DMS/DASLLANALY 
COL_SON BIT(C16)>» % First time at DOL_LEVEL#1 
% tabeted *SN" by OMS/DASDLANALY 
CCL_OBJECT REMAP DDL_SON BAaTC 16)» 2% 
% For set gnc tubsetse points to the DDL entry for the 
x toject structure. 
CCOL_SIZE BIT(16)» Z2 Item length» jin bits 
O03 COL_OFH_AMBR BIT(8)> ZX UFH number if DDL_TYPE = 8 (fite)d 
CCL_CFFSET B@3ITCIEd» 2 Offset» in bits» within its record 
COL_VERIFY_PIR BITC1ib)» 2 it data set» points intc PCLISH tabte 
03 OOL_CCCUFS BITCL0)» 2% if data item» size of CCCUFRS ctause 


O03 COL_FRACVION BIT(6)> % if numeric» numter of decimel piaces 


DCL WHERE _PUF REWAPS ODL_VEKIFY_PIR SITC 16) 
42 Points into FOLISH table» for auto subsets 
COL_FLAGS B8I1(16)}» % Shoula be self-explanatory 
03 COL_FEQUIRED BATC1)» &£ 
03 DDOL_REQUIRED_ALL REMAPS DDL_REQUIRED BITC1)> 2% 
O03 COL_ALL_SETS REMAPS DOL_REQUIED BITC1i)» 2 
2 This remap has ati sets decdared for physical cata set 
O3 CCL_KEY ELL 1)» 2 
03 DOL_VERIFY REMAPS DDL_LKLY BITC1)» 2 
03 COL_WHERE RKEWAPS OCL_KEY BITC1)» 2% 
O03 COL_NCNE FEM*®PS DDL_KEY BITC1I)» 2 This remap has nc sets 
03 COL_KEY_ITEM BITC(1)» 2% 
O03 COL_RESTFICTED_ITEM BITd1)» ZX Key items which cantt change 
O3 COL_SITENED BYTCLI» & 
03 COL_CECIPAL EITCL)» 3 
03 COL_MANUAL_S*TET REMAPS UVDL_DECIMAL BITCL1)» 2 
03 COL_FILLER_ACTDED BITC1I)» Z For index keys 
03 COL_SELECT REMAPS COL_FALLER_ADDED BITCids 2% 
O3 COL_SUBSCRIPT_CNT BIT(2)» 7% 
04 DCIL_EPBEDCED BIT(1)» Z 
04 DPOL_OLO_STRUCTURE BIICL)s % 
% The 32°bit logicat addresses stored within this 
Z structtre are in the pre Mark &.0 format 
03 GOL_INIT_ SIGHED BITC1)» £ The initial vatue is negative 
O3 COL_RECCRO_TIPE BITCL)» 2&2 
O3 COL_HICCEN BITCid» &% 
O03 DDL_REACCNLY BIT(CL I» &% 
03 COL_EXCEPTION BITC1)» % For READONLY fields 
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02 


02 


Aare 


DEL_ANALOG BIICIG2>» 2% 

2 Cnty usec if DOL_RAP_NMbR is not = O» this describes 

% the COL entry nusber for the ites which this ite# remaps 
OCL_INITVAL_PIR B3TC24)» &% 

% Pointer into the Literadi Table for this item*s initiat 

% valuew Refer to the description of the Polish Table 

2 (section 6) for the format of a Literal takie pointer. 
OOL_INIT_FRACTICN BITCE)> & 

2 the number of fractionat digits within the initiai value 


Tabte 


Name Table entries are 17 bytes Long» with 10 entries €170 bytes) 


per cisk sector. The reraining 10 twytes per disk sector are not 


USEQe 


Entry zerc is not usec. 


CECLARE & 
O01 NAME_TABLECIO) CHARPFCTERCI?Z Ds 


Fath Tabte 


The CMS/CASDL compiler generates one Path Table entry for each 


structure tin the cate bate. Each Path Table entry is $4 tits in 


length» 


kith 15 entries rer aisk sector. The remaining 30 bits 


ger sectcr are net usece Entry zero is not used. 
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CECLARE 2 
O1 PATH_TABLE_ENTRY ELW94)> % 
O2 PATH_TYPE BI1C4)» 2 


% 1 2 disjoint cata set 
%2 3 index seqventiat 
x 3 3 index rancom 

% 4 2 ordered tist 

% 5 3 unordered dist 


02 PATH _STR_NMBF_ BIS)» 2 Structure nusber for this path 
O02 PATH_DCL_PIR BIT(16)» 2% DOL entry for this péeth 
% For ordered eubeddedc data sets onty» this points to the 
% CDL entry for the access set of the data set* tc get the CDL 
% entry for suct a data set» use PATH_OBJ_DDL_PIR. 
02 PATH_OGJ_STR_NMBF BIT(8 ds 2% 
% For sets and subsets» this is the structure numter of the 
% data set fcointed to by tne path. 
% For aii déta sets» this is eouat to PATH_STR_AMER 
O02 FATH_OBJ_COL_PTR BITC(16)» % DDL ertry for object structure 
O2 PATK_NEXT_PTF BI1C16)>» % Next path with same otject structure 
02 FATH_KEY_PTR BIT(16)> 2 First entry in KEY tattie for this path 
O02 PATH_FILE_NMER BIT(8)> Z£ Where the peth ts stored 
O02 PATH_DLP_FLA€ BIW1)» % 1 => Duplicates ailtowea 
O02 PATH_DUP_TYPE BI1C1)s 2% Not used 


Key Tabie 


There is ore entry ir the key table for each item used in a key 
clzuse. Fach item ir the table» in addition to the information 
about the key» pecints to a DDL entry If an item is used és a 
key in several paths» then there is one key table entry for each 
path in which that item is used. Aiso» if a group item is usec 
25 a key» then there is cnty one key table entry for the entire 
groupe The subitems wittin the group can be expanded ty 
Erocessing through tke DCL table-~ tach key table entry is 36 
tits longs with 40 ertries per disk sector. Entry zero is not 


usede 
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LECLARE 2% 
O1 KEY_TABLE_LENTRY BIT136)»> 2 

QO2 KEY_TYFE BITt(4)» 2 
2 1 2 ascencing 
2% 2 3 descerdince 
% 3 2 data (not usec) 

O2 KEY_COL_PIR ELYCI6)>» % DDL entry tor this item 

U2 KEY_NEXT_PTR BIT(160)5 2% 
% Next key entry for this pathe If = O» this is the lest 
% key item for this path. 


Attribute Table 


Each entry in the Attribete Tabte corresponds to a physical 
Cawaneter which was expiicitly set in the criginat DrS/DASEL 
source. Each entry is 6€ bits tongs with 24 entries per disk 


sector. Entry zero is nct used. 
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CECLARE 2% 


O01 ATTRIGBUTE_TABLE_ENTFY BITC(60 )}» Z 


02 ATT_IDENT BITC12)> 
O3 ATT_FILE ELTC4)> 


O3 ATT_IC BITCH)» % str. 
N2 ATTI_LTYPE BITS)» & 


% To what does this attribute apply 
% Not used 


# to which this attritute arriies 


% 1 3: KINC 

% 2 3 PACK=-I10 

% 3 2 MULTI_FILE_I0 

2% 4 3 FILE_10 

2 5 s AREAS 

2% 6 3 PRIME 

% ¢ 3 POPULATICN 

% 8 3 LOATFACTCR ~ no longer used 
X% 9 3 SPLITFACTOR 

% 10 = MODULUS 

2 11 : AREALENGTH 

% 12 3 &€LOCKSIZE 

% 13 3: TABLESIZE 

2 14 3 SECUFITYTYPE 

% 15 = SECUFRTTYUSE 

% 416 = SECURITYEUARC FILE FrACK-IC 
2% 17 3s SECUFITYCUARG FILE MULTI-FILE-id 
Z 18 = SECURITYEUARC FILE FILE-ID 

O2 ATT_CDL_PIR ELTCIG)» & 

O2 ATT_ATTRIGUTE EIWC24)3 2 ATT_TYPE 
2 17 3 any cisk {note> = FPB.HDAR) 1 
% 24 3: Jrtréeck tape om 1 
225 3: “track tape = 1 
% 26 3 PE“tzpe wy 1 
Z 27 3 any tape m 1 
% DOL entry nuater 274 
% attrikute vaitwe 5-13 
21 #3 pubtic file 14 
% 2 3 privete fite 14 
20 #3: I/G tile 15 
Zz 1 2 inputwonty file 15 
22 3 outpret-orly file 15 
2 COL entry nunster 16-18 

1152444 F-26 01/19/84 


Polish Tabte 


Every WHERE» VERIFY» and SELECT statement in the data Lase 
cescripticn is ercoded irto Polish notation» where eéch simpte 
condition is represerted as a series of operands followed by en 
eperaztor. Cemplex cconcitions are represented by cencateraticon of 
the strings for each simtte condition within the comptex 
conditions fottlowed ty the operators representing the togicad 
retationship between the sSiwmpie congitions. For examples the 


coeplex cordition: 


A> B AND C = 0 ANC F NEQ O 


Can te decoded into the Tottowing: 


Ae Be™>"eCeLo™=" oT AND" > Eo Oe "NE Qe "AND™ 
The first three items in the string represent A > B» and the next 
three represent C = C.~ #fter both of these simpte reléeticns héve 
teen evaluated» there are two boolean vatues CIRUE or FALSE) 
generatecs the first ANT in the Podish string indicates that 
these two vaiues are to te ccmpareds and the resulting becteen 
value stored. The next three items in the string represent the 
expresston E NES O» ena also result in a tcotean vatue being 
generatece. fhe tast AND indicates again that the top two wadues 
(this times» the resuit of the previous AND operation» and E NEC 
0) are te be ccmpawec.e The result of this tést operéetion» either 
TRLE or FALSE» deteraines if the WHERE» VERIFY» or SELECT clause 


has been satisfied. 
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POLISH tabde ertries are 60 bits longs with 24 entries per disk 


sectcre Entry zere is net usede 
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CECLARE 


z 


O01 POLISH_TAELE_ ENTRY ELTC(60)> &% 


02 


Q2 
92 


FCL_COPERANO_FLAG BIT(1)» X% YU => Operators 1 => operand 

% Next 9 fieles are vatid onty if POL_OPEFAND_FLAG = 3 
PCL_LITVERAL_FLAG BIT(L)» X% 4 => Aiteraltl 
FCL_NUMERIC_FLAG BIT({1)» % YU => alghe» 1 => numeric 

% Next three fietds are vadid onty if POL_NUMERIC_FLAE = 1 
PCL_CECIMAL_FLAG BIT(1i)» 2% 

FCL_SITCNER_FLAG ELTC{1)» 2% 

2 next is vetid onty tf POL_DECIMAL_FLAG = 1 
PCL_FRACTIGN_SIZ* BIT(5)» % Number of decimal places 
FOL_OGPERANOSIZE EILTCL10)» ZX Length in bits 
PCL_CPERAND_ FTA EIT(24)> Z£ LDL entry # if ronwditerat cperand 
O3 FCL_OPERAAD_I®DEX BITCLIL)» %£ Pointer into LITERAL tzble 
03 PCL_OPERAND_OFFSET BIYC1s)» 2% Ctfset within LITERAL entry 


FCL_CPERATOR REM#PS POL_OPEKAND_PTR BITCO)» 2% 
2 2406 2 LSE 

% @41a 2 LES 

% @42¢@ 2 EOL 

% @a435aqa 3 NEC 

% a44a 3 GEC 

% 345¢ 3 GTF 

% 2504 = NGI 

2% a602 3 ANT 

% af70d ; 


OR 
O02 PCL_DATA_CFFSET BYTC16)% &% 


% If the operane is a subscriptec data items this centains the 
% offset of the actual array element referenced in the WHERE of 
2 VERIFY ciléiuse. 


Literal Table 


The Literal Tabte is cogartosed of entries that are one disk sector 


in length» and it is usec to store iiterats for either Potish 


exeressiors cr commert strings within quotation marks. Several 


literals cen be stored within each dLiterad Table entry» cepencing 


upon the length of esch Viteral. Literadis cannot overtap two or 


fore Literal Table entries. Entry zero is not used. 
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CECLARE 2 
G1 LITERAL _TABLE_EATRY BITC1440 )» 2% 
O02 LITERAL» 2% 

% Each titerad sithin a LITERAL table entry starts at 
% PEL_OPERA@AAD_OFFSET bits from the teginning of 
% LITERAL_ TABLE (POL_OPERANU_INDEX) 

O3 LITERAL_SIZE ELITC16)>» % dength in bits of the titeral 

OS LITERAL _WALUE BITCLITERAL SIZE )s 3 


CMSUL Audit File Inforwation 


CMSTI aucit records ere yariable in lengths however» they are 
not the sage type of variable length records that can te created 
ty a user prograg. Every usertcreated variatle tength recorc 
has» as the first fielc in each record» a cescription of the 
ferngth of the record. Fer OMST2 augit records» the tergth of 
each recerc is a functior of the type of audit information which 
the record containse Each OMSIT auait record contains a 
creagble» and usuatiy @ prostambles which icentifies the aucit 
record type anc the structure number affected by the audit. The 
rreasbie and pestambie determine the total tength of the audit 
record. The preambte anc postamble contain the sare informations 
gtiowning the DMS/RECCVERCB program to process these variabie 


length records either forward or backward. 


The OMSI1] system writes zudit recoras into each physical audit 
tlock untii either the block is full or a syncpoint operation 
ccecurse In either czse» the DMSII system initiates 2 awrite I/C 
cperétton cn the buffer containing the block. If tape is used as 
the eudit media» the CMSIT system switches audit buffers 
autonmaticatty at a syncpcint operation (the CMSTI system 


atiocates two audit Lrufters zt audit file open).j If disk is 
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being usec» the CMSI] system continues to use an audit buffer 
after the syncpoint 1/6 tas completeds rewriting the tuffer shen 


the tuffer fiids. Tre fermat of the audit buffer ts: 


CECLARE 2 
01 AUCIT_BLOCK BITCFPE_RECORD_SIZE)» 2 From the AULIT FPE 
O2 AUCIT_CATA BITCFFB_RECORD_SIZE“104)» 2% 
02 AUCTT_CONTRGL_INFO BITC1I04)» 2% 
OF AB_LAST_RECORE BITC1I6)» « 

2 Offset into tte audit btock for the tast recorc. If = a@aFFFFa» 
no aucit records begin or end in this tlocks the entire 
bicck contzins a continuation of a record from a previous 
bicck. See aiso AB_FULL_BLCCK below. 

AB_FIRST_ASN FEITCK32)» 2% 
ASN associatec with the tirst audit record in this tCiock 
AB _LAST_ASN BITC32)» & 
. ASN associatec with the tirst audit record in the next block 


x 
z 
z 
03 
z 
3 
z 
O03 AB_FULL_BLOCK BITC1)» &% 
z 
z 
z 
z 
3 
y 4 


S 


If = il» AE_LAST_RECORD points to the starting position of the 
fast recorc. 

If = O» AE_LAST_RECORE points to unused porticn of the 
btiock. 

AB _ ELCCK_AUMBER BIT(23)5 2Z 

Current tlock number within this zucit filter 0 relative. 


Aucit Types 


The first eight bits of tach audit record contain the audit type 
fieic» which is usea to cescribe the type of information 
contzinec within the audit record. There are two general ciasses 


of audit rececrcs? 


Ts Controt records. These audit records are used for events 
which affect the ertire data base. Each control recoroa 


consists of just tte eight bit audit type field. 
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Ze ' Update recerds.e. Ttese audit records are used to descrite 
changes to specific structures within the data base.» The 
upcate recoras contain the information necessary to either 


reapply» or back ott» sn update. 
The follcwinc is the fornat of the update records: 


*preambie> 3 «variablesdata> * <postamtte> 
The <preambte> consists cf» in orded» the audit record type anc 
the structure number. Ezch of these fietlocs is eight bits in 
length. The <postastle> contains the same two fields» but the 
crcer of the fietds is reversed» allowing the DMS/RECOVERCEB 


rrogram to reac backsarce through an audit file. 


hith the exception cf aucit record type s€3a» the beginning of 
the <variable-cata> portion of each update record éetlways contains 


the following two fields: 


1. Previous audit seriat number (ASN). This field is 32 tits 
in length» and is the ASN which was contained in the 
upcatec bicck gcrior to the upaate being currently auditec. 
This field is used by the OMS/RECOVERDS program to 
determine if a particular audit recerd should cor shoutd rot 
be apptied against a physicat record on disk.» Since 
agisjoirt set recorc formats do not inctuce an ASN fielce 
the previous ASN t¢ nor@wadty zero for audits of data set 
records. Howesxser» if a cata set biock is updated more than 
once white in nemctry» the audits of atti updates other then 


the tirst update centain valia previous ASN fielacs. 
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Ze Logical adoeress- This is always a 24-bit address» 
regardless of the structure type teing audited. For dété 
sets and tists» the record or tabte nusber appears 


immediately after this 24-bit address in the audit reccrce 


All audit record types which share a common function are grouped. 
This grouping is indicated by the first four bits of the audit 


record type field. 


Controt flecords (Type = @Bxa) 


«Bid 3 Syncpoaint 
aBead 2 Cortrotpoint 
«83a 2 Bata Base Close 
2 Used for physical close only» and should be the 
Z tast recerc in the audit fite. A Syncpoint is generated 
2 1f a procram ctoses the data tase while cther users 
2 stilt hawe the data base open. 
«84a 3: Cata Base Oper % Initial open only. 
«852 3 Program Abort 


2 Same as cata base ctoses but used to indicéete that 
4 an abort has forced the data tase to be shut down. 


Standard Data Set tpdates (Type = dixa) 


In atl of the aucit record descriptions in tke renaainder cf this 
cocurents the creviors ASN and togicat address fields are 
omitteds the presence of these fieids is implied in ati cases» 


excect for audit recerd type @db3a. 
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2102 2 Data Set After Imzge (CSTORE after CREATE) 


Forgat: 
Fecord nuater + BITC8) 
New record : BIYUCSTR _RECORD_ SIZE) 
alia =: Data Set Before Inage (QELETL) 
Forwnat: 


Record mumter : BIF(8) 
Cid record > BLIICSTR_RECORD_ SIZE) 
«iza 3: Data Set Eefore ard After Image CSTORE after MOCIFY) 


Formats 
fecord numter = BIIC&) 
Cie record ? BIICSTR_DATA_SIZE) 
New record 3 BLIICSTR_DATA_SIZE) 


Incex Entry Updates (Type = d@2xa) 


«202 2 Insert Table Entry 
Fora@at: 
labile entry nusber = BITCi2) 
New entry > BITCSTR_RECGRO_SI2ZE) 


a2la 2 femove Table Entry 
Fornat: 
Tabte entry nunber = BITC1i2) 
Gic entry 2 BITCSTR_RECGRD_SIZE) 
acca =: Change Index Sequential Root Tabte 


Format: 
Cid root table address : bITC( 32) 
New roct tzeble address =: sITC€ 32) 
ac3a 2 Index Sequential fey Change 
a Used if the tighest key in a dower tevel index 
2 tabie chéenges 


Forgat: 
Entry number 3 BITC12) 
Cta key 2 BITCSTR_KEY_SIZE) 
Kew key 2: BITCSTR_KEY_SI7ZE) 
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Update Index Table Controt Fields (Type = @3x2) 


«303 


a3]a 


a32a 


a33a 


Set Block Type 
Forwat: 

Cle tteck type = BITC2) 

Kew Bleck type 2 BITC2) 
Change Tabte Pext Pointer 
Format: 

Cie next pcinter = BITCK245 

New next pecinter 32 BITC 24) 
Change Yabile Frior Pointer 
Format: 

Cid crior pointer = 81124) 

New prior cointer = BIT(24) 
Charge Tahte Next and Prior Fointers 
Forrat: 


Cic Next 3: BIW24) 
Clo Prior 2 BI1C€24) 
New Next : BITWC(243) 
Kew Frior <: BIWK24) 


Update List Tabtes (Tyre = a4xa) 


a49a 


a4id 


a4h2a 


a43a 


«44a 


a45a 
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Before Image cf List Controt Info 
Formats: 

List table numter = 8I11(85 

Cid control info 3: BITC?) 
After Image of List Controt info 
Format: 

List tahbie nuater = BIT{B) 

New controf info : BITC? 2Z) 
Insert List Recore Into List Tabte 
Format: 

List table numter 

List recore nuwber 

New list recorc 


BITCe) 
BITCb) 
BITCSTR_ENIRY_SIZE) 


oe 88 88 


Remove List FRecorce From List Table 
Format: 

List table numter 3: BITC) 

List recorce nusber : BITCb6) 

Cie record > BIICSTR_ENTRY_SIZE) 
Remcve List Fecorce and Delete List fatte 
Format: 

List table numter = BIT(8) 

Cid control into = BI1T<{%c) 

Cid record s BITCSIR_ENTRY_SIZE) 
Store List Tattle end Insert List Record 
Format: 

List tabte numter = BITC) 

New controt info 2 81172) 
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New record 2 BITCSIR_ENTRY_SIZE) 
e462 2 Change List Recore 
Forgat: 
List tabie numter 
List recorc nusber 
Cic record 
New record 


BITC12) 

BITC{6) 
BITCSTR_DATA_SIZE) 
BITCSTR_DATA_SIZE) 


sé 60 88 be 


List Heac Updates (Type = 25x32) 


In att cases» the parent data set record is teing audited. The 
gucit records tave the szme format whether the parent data set is 
a cisjoint data set cr ar embedded data set.~ However» two of the 
fielcs ir each atdit recerd have ditferent meanings» depencing 
upcn the structure type cf the parent data sete The négmes of 


these fielcs» and their neanings» are? 


1. Parent record rumber. If the parent is a aisjoint czeta 
sete this 18 the record number of the parent déta set 
record. If the parent is a tist» this is the takle numter 


of the parent cata set number. 


Ze Tabte entry nugbers If the parent daté set is a disjoint 
data set» this field is atways zeroew If the parent is a 
list» this is the entry number of the parent records within 
the list tabtle aiready descrited. 


250a 2 List Head After Inage 
Format: 


Farent reccra rumber 2 BITC12) 
List head cffset s BIIC16) 
Tabile entry nurber > BIIcio) 
New fist heac 2? BITC64) 
a512 3 List Head Befcre Image 
Format: 
Farernt reccrd rumber = BIIC12) 
list head cffset > BIITC16) 
Tarnle entry nuaber >: BITCB) 
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Clo list heaa > BII(€64) 
Space Alttocation (Type = 26x22) 


#60a 3 Update Next Avaitebie and Highest Opened 
Forrat: 
Cia Next Avaiteble + BIT{ 32). X HG = NA 
Kew Next Availebtle 2 BIT( 32) 
«612 3 Update Next Availzebte Onty 
Formats 
Cia Next Availzbte : BITC32) 
New Next Availebte =: BITC 52) 
ea6¢2qa 3 Return Space to Next Avaitabie 
Forsnat: 
Kew Next Avatilzeble 
Cid Next Avaitleble 
a63da 2? Oper New Area 
2 The format of the <variabiedata> for this record 
Z only includes the following fietds> there are no 
2 fieids in thie audit record for previous ASN or 
% togicai acdress 
Format: 
New area nurgeber = BITCS) 


BI¥C32) 
BITC 32) 


Index Splits and Coabires (Type = @7xa) 


When DMSII splits or comtines index tables» entries are removec 
from an existing table ard inserted into a new tables these 
ections require» in ~edcition to the two records for the insertion 
anc celeticns records which reflect the space aliocetion for the 
rew tabde» ard require tte modification of the next énc prior 


cointers in the affectec tables. 


Since the actual size of the audit record degends upon the numter 
ef entries to te moved» the number of entries moved fieloc appeers 
twice in each eudit recotd to attow the auacit fite te ke read in 


reversee 
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Fach of the four types of audit records have exactly the same 


for@wats this format is listec onty for the first of these. 


af7Qa 3 Insert Entries Into Front of Tabie 


For#at : 
Number of entries to be moved =: 61112) 
Entries moved 2 (*) 
Number of entries to be moved 3 B8I1{12) 


(*) The totat lencth» in bits» of the entries to te moved is 
equal to: 


Centries to be moved) x STR_RECORD_SIZE 


s7ia 2? Insert Entries Into Back of fable 
Format: same ¢s fer 2702 

«eféa 2 Remove Entries Frem Front of Tabte 
Format? same @s fer a70e 

a?3a 2 Remove Entries Frem Back of iabte 
Format? same es fer a70a 


1152444 F-38 01/15/84 


APPENDIX G 


NCTATION COAVENTIONS AND SYNTAX SPECIFICATIONS 


The fotlewing paragraphs describe the notatien and syntax 


conventions used in this manuat. 


ROTATION COAVENTIONS 


The fotfowing paragréephs describe the notation conventions. 


Left and Right Broker Breckets (<>) 


Left and right broken brecket characters are used to enctose 
ietters anc cicits which are supplied by the usere The tetters 
anc cigits can represent a variables» a numters a file nagwer or a 


commend. 


Example: 


ajob #>AX%<cosmanc> 
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AT SIGN (a) 


The at sign (2) chareéecter is used to enctose hexadecimat 


informatione 
Exemples 


aF3a is the hexadecimal representation of the EBCDIC 


character 3. 


The at sign (a) charéecter is also used to enclose Linary or 


nm 


hexacecinadi information then the initial @ character is fottowed 


ty a €1) or (C430 rescectively. 
Examples: 


2€1)111100113 is the binary representation of the EBCOIC 


character 3. 


aC4)0F3a is the hexzdecinvat representation of the EECDIC 


character 3. 
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<identifier> 


An icentifier is a strine of characters used to represent some 
entity» such as an itea rame composed of detters» cigits» and 
hyphen. An tocentifier cen vary in dength from 1 to 17 
cheracters.e The characters must be adjacent» the first cheracter 
of an identifier must be a lettersr and the tast charecter cannot 


te a hypher. 

<integer> 

An integer is specified ty a string of adjacent numeric cigits 
representing the decimal value of tne intecer. 


<«hexadeciast-nuaber> 


A hexadeciwal rumber is specified by a string of numeric digits 
enc/or the characters A through Fs this string is enciosed 


within the at sign (4) characters. 
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<detiniter> 


A celimiter can be any nenwalphanumeric character. The hyphen 


exctuded. 


<diterat> 


A literal is a data item whose value is identicadi to the 


1s 


chéeragcters contained wittin the ites. A literal can be either an 


éi{phanumeric Cor siwgpty zetpha) literal» or a numeric literati. 
Aichae titerals can ccntain any combination of vatlia printable 
characters» cr spaces» ard must be enclosed ty quotation (") 
cherecterss a quotation character within an atpha literal is 
representec by two stccessive quotation chéaréecters within the 


character string. 


Exsaple: 


ABC** DEF 
The prececing alpha titerval could be used to represent the 


cherecter string ABC*DEF. 


humeric diterails can contain only the decimat digits 0 through § 


and are not enciosed within any delimiters. 
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SYATAX CONVEATIOANS 


Railroad diagrams shcw hew syntacticatty valid statewents can te 


constructeéce 


Ireversing a railroac diggraae from deft to right» or in the 
cirection of the arrcwhezds» and adhering to the timits 
ifdustratec by bridges produces a Syntacticaily vatlic statement. 
Continuation frog one tire of a diagram to another is represented 
ky a right arrow (Clrae) arpearing at the eno cf the current line 
anc the heginning of the next linee The cemptete syntéex diagréa 


is terminated by a verticat tar Civa)d. 


Items contéinec in broker brackets (< >) are syntactic variables 
which are further definec or require the user to suppty the 


recuestec informatior. 


Lpper=case itesws must aprear literaily. Mintmaum abbreviations of 


upper "case ites are undertinea.~ 
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qecr-/ z \-~-= , camsaawwevase | 


-- A RAILRCAL CIAGKAK CONSISTS OF ------ 


>-- ANC 15 TERMINATED EY A VERTICAL BAR. 


<tridges> seseeeee ees 
<toops> vensee eect 
<optional items> ae 
<required items> ~-1 


The fottowing syntactically valid statements can be constructec 


free th 


1152444 


e preceding ciagrem: 
A RAILAFCAD OFAGRAP CONSISTS OF 
BY A WERTICAL BAR. 


A RAILRCACG DIAGRA® CONSISTS oF 
TERMINATED BY A VERTICAL BAR. 


A RAILRCAD DIA@GRA® CONSISTS uF 
TERMINATED BY A WERTICAL BAR. 


A RAILKACAL OLTAGRA® CONSISTS OF 


iters>» <bridges>» <tloops> AND 
BAR. 


G~-6 


<bridges> AND IS TERMINATED 


<optional iteas> ANCE IS 


<bridges>» <loops> AND I§ 


<optional items>» <required 
IS TERFINATEDC EY A WERTICAL 
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Required Iteas 


Ao alternate path througt the railroad diagram exists for 


required items or recuired punctuation.e 


Examples 


<== REQUIRED ITEP coer enna nen nen n nn eennn---] 


Cptionat Iteas 


Items shown as a vertical tist indicate that the user must make a 
choice of the items specified. An empty path through the List 


eilows the optional item to te absent. 


Exaarte: 


| 1 
f-- <optionaa itemel> --i 
4 
t-- <optionat itemce2> -<!1 
The following valid statements can Ge constructed from the 


fFreceding ciagram: 


REQUIRECT ITE™ 
REQUIREC ITEM <optionat item-1> 


FEGULIRED LTTEM <optional item-2> 
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Loops 


A locp is a recurrent path through a railroac diagram and has the 
following generat format: 

I<e-- <bridge> <return character> ----1! 

1 i 
Exempte: 


P<nns 1 Nort rre 9 coer errr re nn) 


I i 
l-- <optional item-2> -~1 


The following statements can be constructec from the rzilroad 


ciggram in the example: 


<optionat item*1> 
<optional item-2> 
<optionatl item-1>»<optional item-1> 
<optionai item*l>»s<optionat item-2> 
<optionad item-2>s<optionsal item-1> 
€aptional item-2>s<optional item-2> 
A <loop> must be traversed in the direction of the arrowheads» 


anc the liwsits specitied by tridges cannot be exceeded. 
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Bridges 


A tridge indicates the minimum or maximum number of times 2 path 


can te traversed in @ raitroésd diags am. 
There are two forms cf <tridges>. 
/ny r is an integer which specifies the saximug 


rumber of times the path can be traversec. 


/on* \ r* if an tnteger which specifies the tiniaua 
rumber of times the path must te traversed. 


Exemple: 


Drees 2 \eerrernnese p ceemeenccees==| 


su unmreeuneaens ene <optiona item71> ssa cen came weer ae ewe ae ee | 


| i 
ie--s/ Le N\- «optional item-<> -~1 


The loop can be traversece a maximum of two times? however» the 


path for <cptional itea-<¢> must be traversed at least once. 
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The following statements can be constructec from the rzilroad 


ciagram in the exampie: 


<cptionalt itera-2> 
<optionad jitea-1>sxoptional item-2> 
<optional iter“2>s<optional item-2>»<optionat item-1> 


<optionad itex-2>e<optional item"2>s<optional item-2> 
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INDEX 


<>» Left and Right Broker Brackets 
<audit recerd type> 10°19 
<AX or AC commanc> Lies 
*cata base name> 1{-6 
<delimiter> C74 

<disjoint cata set> 5-8 
<embeddec structure> 3°5 
<femily nawre> 10-7 

<fiie equates> 1i<3 
<hexedecimal-number> G=3 
<identifier> G-3 

<irdex sequential set> 3-5 
<integer> e=3s 

*literal> G-4 

<numter 1> 10-8 

<numbter 2> 10-8 

<option> 10-3 

«str id> 11°13 

<structure name> 16-15 


«structure number > 190-15 
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*switch settings> 11°73 
<switches> 7-5 
<usercode> 5°9 


«virtual disk> 11-4 


a» At Sign Character G-2 


“CANK*T CPEN FILE FOR <str#>3 <str name>" 11°64 


Abnormat Concitions anee 

Abort Messages 11-62 

ACCEFT CAX or AC} SYSTEM TOMMAND 41-9 

Accept Syste# Cogsmancs OSS/DEMAP Program 11-39 
ACCESS A-1 

Access» CMSII 5*5 

Adcing Data Items 3-14 

Adcing Esteddec Data Sets anc Manuad Subsets 3718 
Adcing Sets anc Automatic Sutsets 3-18 

Accition and Detletior of Data Items S719 
Accitionadl Muttiprograasing Considerations 4°50 
ADCITIONAL MULTIPROGFAM*MING CONSIDERATIONS 4-50 
Adwiristrator im1 

AFTER 10-19 

Aitgorithms 3-30 

Atgorithas» MCFII Mesory Management E-2 

ALL 3-10» 1i-12 


ALL CDS 1i-12 
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ALL 


ALL 


ALL 


ALL 


ES 11712 
10x Ji-12 
Initialization of Cata Items bw3 


INITIALIZATICN OF DATA ITEMS b- 3 


Anelyzing» OMS/AUCITANAL)Y Program 10-1 


Anéetlyzings OMS/DASDLANALY 7-i 


Applicaticn Ew40» E438 Er4S 


AREAS 10714 


ASAS Stategent 10°16 


Assignment of Code Seqmerts E75 


Assumptions E“405 Er432 E45 


AT SIGN Ca) €-2 


Attribute Tabte (73, Fe25 


Aucit Biecksize 4-24 


Aucit Euffers Eu7 


Aucit by Program 4-42 


Aucit by Staticn 4-42 


Aucit File Informaticn Block E-6 


Aucit File Pargemeter Block CFPB) q72 


Aucit Function 4-6 


Aucit Mecié 4-25 


Aucit Trait 4-2 


Aucit Types F-31 


Auto#atic Sets ons 


Automatic Subset 2°10 


" 


Automatic Subsets en74 
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Backed Qut Transacticns 4-46 

Falarce of an Incex Set cr Subset 3-39 
Basic Procedures 4-33 

Eatch Programs 4-38 

GEF CRE 10°19 

Eegin=transaction anc Ercetransaction Operations £-31 
Eegin Transaction Operation E-31 

ELCCKS 10-14 

tlocksize for Aucit Fite 4h~-2h 

Bridges €-9 

Ercken Brackets (<>)» Left and Right G~1 
Euffer Descriptors E-14 

Buffers E~14 


Euffers» Kidcen E-16 


CAN CNLY PAP 11.0 DATABASES 11-63 

CAN'Y REACT CICTICNARY FILE HEADER 11-64 

CANNCT MAP ACTIVE DATABASE 11-63 

CANNCT MAP DATABASE BHITH ACTIVE FIL&is <filename> 11-63 
CARD 11-8 

Changing Groupings or Levels 3-16 


Chenging Populations 3°18 


Charging Structure Attritutes 3-1é 
Changing the Description of Data [tems 3-15 
Chéenging the Descriptions of Sets and Autcmatic Subsets 3716 


Chenging the Ordering of Data Items 3-16 


Clear7"Start Recovery 4°15 
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Ciose Gperétion E-21 

Clesing a Cata Base 4-f€ 

CLUSTER 11-13 

CLUSTER EXFECTED 11719 

Code Requiresents of MCPYTI E-3 

Code Segment Assignments B-5 

COCE SEGMENT ASSIGNMENTS B-5 

COMMAND ERFORS Liwis 

Command Errorss OMS/TBMAF Program 11-19 
Coemends 11-10 

Compiling Fregrams 5-1¢ 

Compiling the Cata Bese 5711 
Compiting the CMS/DEMAP Frogram 1in-4 
Comptetion of 2 Single Transaction 4-6 
Conclusion 5°13 

Considerations» Multiprocramming 4-50 
Considerations» Throighptt 4-22 
CONTENTICN A-1 

COATFOL 10-15 

Controt Records (Type = @Bxa) F-3%5 
Controtpoint 4-10 

Cortrotpoints 4°29 

Conventions» File Nawing 3-28 
Corventions» Notatiors G-1 
Conventions» Syntax Lescription G-5 
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